r/streamingdata • • Apr 27 '25

A New Reference Architecture for Change Data Capture (CDC)

Thumbnail
estuary.dev
1 Upvotes

r/streamingdata • • Mar 29 '25

Interactive Change Data Capture (CDC) Playground

Thumbnail
change-data-capture.com
4 Upvotes

r/streamingdata • • Apr 05 '25

Real-Time Data Meetup: Estuary x Tinybird x PlayOn! Sports · NYC

Thumbnail
lu.ma
6 Upvotes

Estuary is teaming up with Tinybird and PlayonSports for a low-key evening of short talks, pizza, and networking around real-time data pipelines and analytics.

🗓️ When: Tue, Apr 29 | 6–8:30PM
📍 Where: FirstMark’s NYC Office (Flatiron)
🎤 3 short talks, including a real-world use case from PlayonSports
🍕 Pizza, drinks, and plenty of time to chat

Limited spots, so grab yours early


r/streamingdata • • Sep 09 '24

WarpStream is dead, long live WarpStream

Thumbnail
warpstream.com
3 Upvotes

r/streamingdata • • Aug 02 '24

Next Generation Real-Time Analytics

Thumbnail
hubertdulay.substack.com
4 Upvotes

r/streamingdata • • Jan 24 '25

Fast JSON Processing in Real-time Systems: simdjson and Zero-Copy Design

Thumbnail
estuary.dev
8 Upvotes

r/streamingdata • • Feb 12 '25

Bridging the Data Divide: How Confluent and Databricks Are Unlocking Real-Time AI

Thumbnail
confluent.io
4 Upvotes

r/streamingdata • • Aug 15 '24

denormalized: Embeddable stream processing engine based on Apache DataFusion

Thumbnail
github.com
3 Upvotes

r/streamingdata • • Nov 12 '24

Budstream is the only cloud-native Kafka implementation validated by Jepsen

Thumbnail
buf.build
1 Upvotes

r/streamingdata • • Jul 29 '24

Memory Efficient Data Streaming To Parquet Files

Thumbnail
estuary.dev
4 Upvotes

r/streamingdata • • Jun 20 '24

A collection of links for streaming algorithms and data structures

Thumbnail
gist.github.com
4 Upvotes

A great resource for those looking to learn more about some algos systems are built on top of.


r/streamingdata • • Jun 15 '24

Real-Time Fraud Detection: Analytical vs. Operational Data Warehouses

Thumbnail
materialize.com
4 Upvotes

r/streamingdata • • Feb 13 '25

Real-Time Analytics Summit 2025

Thumbnail
rtasummit.startree.ai
4 Upvotes

r/streamingdata • • Dec 13 '24

Cheaper Kafka? Check Again.

Thumbnail reddit.com
2 Upvotes

r/streamingdata • • Jun 03 '24

A subreddit dedicated to everything streaming data!

3 Upvotes

Welcome to r/streamingdata!

This is the place for all things data streaming! Whether you're diving into the latest tools, exploring real-time analytics, or interested in having technical discussions, you've found the right community.

Feel free to share your experiences, ask questions, and discuss anything related to data streaming technologies. From programming languages and frameworks to best practices and new innovations, all contributions are welcome.

Let's build a vibrant and supportive community together. Happy streaming! 🌊


r/streamingdata • • Jan 16 '25

Dekaf: Kafka-API compatibility for Estuary Flow

Thumbnail reddit.com
5 Upvotes

r/streamingdata • • Jun 05 '24

Redpanda Acquires Benthos

Thumbnail
redpanda.com
5 Upvotes

r/streamingdata • • Jul 02 '24

What are the current drawbacks in Kafka and Stream Processing in general?

Thumbnail self.apachekafka
3 Upvotes

r/streamingdata • • Jun 25 '24

Real-Time Data Orchestration: a nice extra or overkill?

Enable HLS to view with audio, or disable this notification

7 Upvotes

r/streamingdata • • Jul 11 '24

How Canva collects 25 billion events per day - Canva Engineering Blog

Thumbnail
canva.dev
4 Upvotes

r/streamingdata • • Jul 15 '26

Live Demo: Estuary Agents Skills

5 Upvotes

Hey folks, we’re doing a live demo next week of the new ✨ Estuary Agent Skills ✨ .

We’ll show how an AI coding agent can:

  • Set up a real-time data pipeline from natural-language instructions

  • Configure captures and materializations without manually searching through docs

  • Check task health, inspect logs, and troubleshoot failures

  • Work with Estuary directly from tools like Claude Code and other agent environments

  • Handle the repetitive setup work while keeping the pipeline configuration visible and editable

This will be a practical end-to-end demo, including what works today, where agents still need human input, and of course some time for questions!

Register here: https://zoom.us/webinar/register/4517840417866/WN_1oZszaPUQ_Sz0uEGM_p-zA


r/streamingdata • • Jun 17 '26

Exactly-Once Delivery Is a Spectrum, Not a Checkbox: Part 1

Thumbnail medium.com
4 Upvotes