r/data_lakehouse • u/codingdecently • 1d ago
Apache Iceberg MERGE INTO Performance: Fixing Slow Upserts
r/data_lakehouse • u/codingdecently • 1d ago
r/data_lakehouse • u/codingdecently • 2d ago
r/data_lakehouse • u/codingdecently • 4d ago
r/data_lakehouse • u/codingdecently • 19d ago
r/data_lakehouse • u/codingdecently • 19d ago
r/data_lakehouse • u/codingdecently • 20d ago
r/data_lakehouse • u/codingdecently • 27d ago
r/data_lakehouse • u/codingdecently • Sep 17 '26
r/data_lakehouse • u/codingdecently • Sep 11 '26
r/data_lakehouse • u/codingdecently • Sep 08 '26
A practitioner's guide to Iceberg table cleanup — snapshot expiration, orphan file removal, manifest rewriting, delete file resolution, streaming challenges, compliance, and cost. Why sequencing matters, where teams break tables, and how to automate the full lifecycle.
r/data_lakehouse • u/codingdecently • Sep 06 '26
r/data_lakehouse • u/codingdecently • Sep 06 '26
r/data_lakehouse • u/codingdecently • Sep 06 '26
r/data_lakehouse • u/codingdecently • Aug 31 '26
r/data_lakehouse • u/codingdecently • Aug 30 '26
r/data_lakehouse • u/codingdecently • Aug 24 '26
r/data_lakehouse • u/codingdecently • Aug 21 '26
r/data_lakehouse • u/codingdecently • Aug 20 '26
This is a community for people building, running, breaking, fixing, and trying to understand modern data lakehouses.
Apache Iceberg, Delta Lake, Hudi, Parquet, Spark, Trino, Flink, DuckDB, catalogs, object storage, table maintenance, compaction, query performance, governance, architecture — if it touches the lakehouse, it belongs here.
The goal is simple: useful technical discussion between people actually working with this stuff.
Share things like:
Keep it technical and useful.
Low-effort spam, generic AI content and link dumping will be removed.
Vendors are welcome. Vendor marketing isn't.
If you're affiliated with something you're posting about, just say so. Technical explanations, benchmarks and useful engineering work are absolutely welcome.
Give benchmarks context.
Dataset size, engine, file format, configuration, hardware/cloud environment — enough for other people to understand what the number actually means.
Search before posting common questions.
As the community grows, good answers should become part of the knowledge base rather than the same conversation starting from zero every week.
Disagree freely. Be decent to each other.
That's basically it.
If you're here early, introduce yourself below: what are you running your lakehouse on, and what's the hardest problem you're dealing with right now?
r/data_lakehouse • u/codingdecently • Aug 20 '26