Skip to content
#

realtime-data-pipeline

Here are 3 public repositories matching this topic...

Language: All
Filter by language

A big data project to develop a real-time data pipeline for analyzing the popularity and sentiments of trending topics on Twitter.

  • Updated Jun 21, 2022
  • Scala

Low-latency real-time fleet telemetry pipeline. Ingests, validates, and statefully aggregates (sliding event-time windows) vehicle diagnostics under 148ms. Features Kafka buffers, PyFlink stream-processing, S3 checkpoints, and Redis active cache serving. Handles 50k events/sec with custom watermark handling, and schema validation gates.

  • Updated Jul 12, 2026
  • Python

Improve this page

Add a description, image, and links to the realtime-data-pipeline topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the realtime-data-pipeline topic, visit your repo's landing page and select "manage topics."

Learn more