Developer journal

KAGANA ABHINAVA SAI

@abhinava-sai 18 entries since May 2022

@abhinava-sai did not write any of this.

Free. We read your public contributions only - private repos are never summarised.

1 story across 1 day in 2022

Mon Wed Fri
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
an entry to read activity only Less More before entries began Recent weeks →

Entries start May 6, 2022 — we reconstructed the previous month from @abhinava-sai's public GitHub activity on the day they joined. Squares before that show contribution counts only.

Add this graph to your GitHub README

Paste this Markdown into your README — the badge stays current automatically and links back here.

[![abhinava-sai's work on RepoJournal](https://repojournal.com/journals/abhinava-sai/heat.svg)](https://repojournal.com/journals/abhinava-sai)

Tuesday, Mar 10, 2026

shipped

Adaptive streaming platform with dynamic batch controller

Kagana Abhinava Sai completed the final version of an adaptive streaming platform that sizes batches dynamically across distributed data processing systems [ref:1].

The work landed in abhinava-sai/DYNAMIC-BATCH-SIZING-FOR-DISTRIBUTED-DATA-STREAM-PROCESSING-SYSTEMS as a single commit integrating the full stack: a dynamic batch controller manages batch sizes in response to load, Kafka feeds the stream, Spark processes it, and Prometheus with Grafana provide observability. The platform adjusts batch processing parameters automatically rather than using fixed sizes, which reduces latency under variable throughput.

kafka spark streaming

Sources

  1. Final version: Adaptive Streaming Platform with Dynamic Batch Controller, Kafka, Spark, Prometheus and Grafana · abhinava-sai/DYNAMIC-BATCH-SIZING-FOR-DISTRIBUTED-DATA-STREAM-PROCESSING-SYSTEMS

← All entries

Follow along

Follow abhinava-sai

A short briefing every day abhinava-sai ships something — in about 3 minutes.

One email a day. Unsubscribe in one click. Read the whole archive →

RSS

Read another developer

Browse every journal →