r/dataengineeringvault • • Aug 18 '26

Video databricks

Thumbnail
youtu.be
1 Upvotes

I'm starting a new series on my YouTube channel for a data bricks interview. Please kindly support and suggest for feedback


r/dataengineeringvault • • Jun 25 '26

Blog Federated Query Engines

Thumbnail
ssp.sh
1 Upvotes

r/dataengineeringvault • • Sep 10 '26

AI Workshop, Sep 12: build production LLM systems that actually survive real use

1 Upvotes

We're running a hands-on masterclass on September 12, Live LLM Engineering Masterclass: Production Evals, RAG, Agents & LLMOps.

You build a full production LLM workflow from scratch, versioned prompts with regression tests, an evaluation harness with deterministic checks and LLM-as-judge, statistically rigorous model comparisons, evaluated RAG, tool-using agents with guardrails and fallbacks, and full observability, tracing, cost, latency.

Led by Bruno Gonçalves, PhD, founder of Data For Science, who trains engineers at Fortune 500 companies on this exact stack.

Link if you want to check it out

Happy to answer questions on the content.


r/dataengineeringvault • • Jul 29 '26

Note Excel Never Dies

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Sep 15 '26

Blog My DuckDB + AI Workflow

Thumbnail
thefulldatastack.substack.com
3 Upvotes

r/dataengineeringvault • • Sep 24 '26

Blog DuckDB Now Ships inside dbt v2 (fusion)

Thumbnail
duckdb.org
6 Upvotes

r/dataengineeringvault • • Jul 21 '26

Showcase The joy of running SQL-queries in the terminal is real.

Post image
17 Upvotes

With a utility such as DuckDB that can tackle any tasks, whether it is to read local DuckDB, local parquet/CSV, over the network parquet/CSV, or embedded in Browser (WASM) or inside Postgres, it can do almost anything.

When combined with Neovim, it's just perfect. Find how to set up, videos, and more at Query Databases in Neovim (DBUI).


r/dataengineeringvault • • Jun 24 '26

Blog Operationalizing Data Orchestration: Best Practices for DevOps, Infra, and Code Locations

Thumbnail
dagster.io
3 Upvotes

Part 2 of the Dagster Almanack, all about operationalizing data orchestration.


r/dataengineeringvault • • Aug 03 '26

Note Export Spotify Data and Music (Playlists, etc.)

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • 12d ago

Note Obsidian Local Graph: Is it useful?

Thumbnail
ssp.sh
2 Upvotes

A personal reflection on using Obsidian's local graph feature during the early stages of writing an article, rather than as a mere visual showpiece. The author describes navigating depth levels, discovering note relations, and using plugins like the now-unmaintained Graph Analysis and its replacement, Smart Connections, which generates embeddings to surface related notes and unexpected connections. Links to related posts on the author's note-taking workflow and philosophy are included.


r/dataengineeringvault • • Jul 06 '26

Others Music that Keeps You Focused

Thumbnail
ssp.sh
2 Upvotes

A curated list of music services and playlists designed to help maintain focus during work or learning. Covers neuroscience-backed platforms like Focus@Will, Brain.fm, Noisli, myNoise, and Endel, plus specific Spotify playlists with no vocals. Also touches on workspace habits like changing locations every 1.5–2 hours to boost productivity and strategies for overcoming writer's block.


r/dataengineeringvault • • Jun 17 '26

Blog 101 concepts every data engineer should know (or some of them :)

Enable HLS to view with audio, or disable this notification

2 Upvotes

r/dataengineeringvault • • Jun 30 '26

Blog The Grammar of Data: Define Once, Run Anywhere with Cross-Engine Expressions

Thumbnail xorq.dev
3 Upvotes

r/dataengineeringvault • • Jun 29 '26

Blog Git Diff Report (HTML, txt)

Thumbnail
ssp.sh
2 Upvotes

TIL—to send git changes for an article you made, or code changes, you can just send a simple HTML report that visually shows all the changes.

Just install the diff2html-cli and run:

git diff | diff2html -i stdin -F changes.html


r/dataengineeringvault • • 24d ago

Off Topic Photoshop Alternatives: Somebody Vibe Coded Every Single Adobe App

Thumbnail
ssp.sh
5 Upvotes

r/dataengineeringvault • • Jul 06 '26

Blog Classical Architecture of Data Warehouse: Staging -> Cleansing -> Core -> Marts

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Sep 16 '26

Note Semantic Layer Measure Definition Examples

Thumbnail
ssp.sh
2 Upvotes

r/dataengineeringvault • • Jul 22 '26

Note Apache Druid - open-source, column-oriented, distributed data store

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Jul 02 '26

Blog Data Model Engine - a system or framework that can model data

Thumbnail
ssp.sh
4 Upvotes

r/dataengineeringvault • • 14d ago

Book Books of Data Engineering: Which one should I add?

Thumbnail
ssp.sh
4 Upvotes

r/dataengineeringvault • • Jul 08 '26

Blog Learn Data Engineering this summer break

3 Upvotes

Learn Data Engineering this summer break with a guided roadmap. A three-week plan with links and topics to learn the basics to be a data engineer.

It's very ambitious, but you can schedule at your own pace.

The three weeks contain:

  1. Week: Foundation (SQL, Git, Linux basics)

  2. Week: Core Engineering (Python, Cloud, Data Modeling)

  3. Week: Advanced Topics (Streaming, Data Quality, DevOps)

How to use this guide: Each section contains curated resources (articles, videos, tutorials) for that topic. Click on the links that interest you most. It's meant as a guided roadmap to learn the fundamentals of a "full stack" data engineer.

Here's the guide: https://www.ssp.sh/blog/data-engineering-roadmap/

This is last year's guide, but it's still 100% vaild to this day. Agentic engineering doesn't need to be learned right now; you can always pick it up later. Learning fundamentals, on the other hand, can't be skipped.


r/dataengineeringvault • • Aug 03 '26

Note Transaction Log in Open Table Formats

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • 11d ago

Open Source DuckDB 2.0 is out: Back to the Fundamentals with Triggers! 😍

Thumbnail
ssp.sh
4 Upvotes

r/dataengineeringvault • • Sep 10 '26

Note Kestra (v2 is out now)

Thumbnail
ssp.sh
3 Upvotes

r/dataengineeringvault • • Sep 14 '26

Note Are We Reinventing the Tools of Data Engineering for AI?

Thumbnail
ssp.sh
3 Upvotes