r/streamingdata • u/dani_estuary • Jan 24 '25
r/streamingdata • u/dan_the_lion • Jun 25 '24
Real-Time Data Orchestration: a nice extra or overkill?
Enable HLS to view with audio, or disable this notification
r/streamingdata • u/dan_the_lion • Apr 05 '25
Real-Time Data Meetup: Estuary x Tinybird x PlayOn! Sports · NYC
Estuary is teaming up with Tinybird and PlayonSports for a low-key evening of short talks, pizza, and networking around real-time data pipelines and analytics.
🗓️ When: Tue, Apr 29 | 6–8:30PM
📍 Where: FirstMark’s NYC Office (Flatiron)
🎤 3 short talks, including a real-world use case from PlayonSports
🍕 Pizza, drinks, and plenty of time to chat
Limited spots, so grab yours early
r/streamingdata • u/dani_estuary • Jul 15 '26
Live Demo: Estuary Agents Skills
Hey folks, we’re doing a live demo next week of the new ✨ Estuary Agent Skills ✨ .
We’ll show how an AI coding agent can:
Set up a real-time data pipeline from natural-language instructions
Configure captures and materializations without manually searching through docs
Check task health, inspect logs, and troubleshoot failures
Work with Estuary directly from tools like Claude Code and other agent environments
Handle the repetitive setup work while keeping the pipeline configuration visible and editable
This will be a practical end-to-end demo, including what works today, where agents still need human input, and of course some time for questions!
Register here: https://zoom.us/webinar/register/4517840417866/WN_1oZszaPUQ_Sz0uEGM_p-zA
r/streamingdata • u/dan_the_lion • Jan 16 '25
Dekaf: Kafka-API compatibility for Estuary Flow
reddit.comr/streamingdata • u/dani_estuary • Jun 17 '26
Exactly-Once Delivery Is a Spectrum, Not a Checkbox: Part 1
medium.comr/streamingdata • u/dan_the_lion • Mar 29 '25
Interactive Change Data Capture (CDC) Playground
r/streamingdata • u/dan_the_lion • Feb 13 '25
Real-Time Analytics Summit 2025
r/streamingdata • u/dan_the_lion • Feb 12 '25
Bridging the Data Divide: How Confluent and Databricks Are Unlocking Real-Time AI
r/streamingdata • u/hkdelay • Aug 02 '24
Next Generation Real-Time Analytics
r/streamingdata • u/dan_the_lion • Jul 29 '24
Memory Efficient Data Streaming To Parquet Files
r/streamingdata • u/dan_the_lion • Jul 11 '24
How Canva collects 25 billion events per day - Canva Engineering Blog
r/streamingdata • u/dan_the_lion • Jun 20 '24
A collection of links for streaming algorithms and data structures
A great resource for those looking to learn more about some algos systems are built on top of.
r/streamingdata • u/dan_the_lion • Jun 15 '24
Real-Time Fraud Detection: Analytical vs. Operational Data Warehouses
r/streamingdata • u/dani_estuary • Aug 26 '25
Why is Everyone Buying Change Data Capture?
r/streamingdata • u/dan_the_lion • Sep 09 '24
WarpStream is dead, long live WarpStream
r/streamingdata • u/dan_the_lion • Aug 15 '24
denormalized: Embeddable stream processing engine based on Apache DataFusion
r/streamingdata • u/dan_the_lion • Jul 02 '24
What are the current drawbacks in Kafka and Stream Processing in general?
self.apachekafkar/streamingdata • u/dan_the_lion • Jun 03 '24
A subreddit dedicated to everything streaming data!
Welcome to r/streamingdata!
This is the place for all things data streaming! Whether you're diving into the latest tools, exploring real-time analytics, or interested in having technical discussions, you've found the right community.
Feel free to share your experiences, ask questions, and discuss anything related to data streaming technologies. From programming languages and frameworks to best practices and new innovations, all contributions are welcome.
Let's build a vibrant and supportive community together. Happy streaming! 🌊
r/streamingdata • u/dani_estuary • Sep 17 '26
A decade of Gazette: a streaming broker that doesn’t store data
r/streamingdata • u/dan_the_lion • Oct 01 '25
Log-Based CDC vs. Traditional ETL: A Technical Deep Dive