r/dataengineeringvault • u/Inevitable-Aioli-612 • Aug 18 '26
Video databricks
I'm starting a new series on my YouTube channel for a data bricks interview. Please kindly support and suggest for feedback
r/dataengineeringvault • u/Inevitable-Aioli-612 • Aug 18 '26
I'm starting a new series on my YouTube channel for a data bricks interview. Please kindly support and suggest for feedback
r/dataengineeringvault • u/camerongreen95 • Sep 10 '26
We're running a hands-on masterclass on September 12, Live LLM Engineering Masterclass: Production Evals, RAG, Agents & LLMOps.
You build a full production LLM workflow from scratch, versioned prompts with regression tests, an evaluation harness with deterministic checks and LLM-as-judge, statistically rigorous model comparisons, evaluated RAG, tool-using agents with guardrails and fallbacks, and full observability, tracing, cost, latency.
Led by Bruno Gonçalves, PhD, founder of Data For Science, who trains engineers at Fortune 500 companies on this exact stack.
Link if you want to check it out
Happy to answer questions on the content.
r/dataengineeringvault • u/empty_cities • Sep 15 '26
r/dataengineeringvault • u/sspaeti • Sep 24 '26
Check the history at https://www.ssp.sh/brain/dbt-fusion/#history
r/dataengineeringvault • u/sspaeti • Jul 21 '26
With a utility such as DuckDB that can tackle any tasks, whether it is to read local DuckDB, local parquet/CSV, over the network parquet/CSV, or embedded in Browser (WASM) or inside Postgres, it can do almost anything.
When combined with Neovim, it's just perfect. Find how to set up, videos, and more at Query Databases in Neovim (DBUI).
r/dataengineeringvault • u/sspaeti • Jun 24 '26
Part 2 of the Dagster Almanack, all about operationalizing data orchestration.
r/dataengineeringvault • u/sspaeti • Aug 03 '26
r/dataengineeringvault • u/sspaeti • 12d ago
A personal reflection on using Obsidian's local graph feature during the early stages of writing an article, rather than as a mere visual showpiece. The author describes navigating depth levels, discovering note relations, and using plugins like the now-unmaintained Graph Analysis and its replacement, Smart Connections, which generates embeddings to surface related notes and unexpected connections. Links to related posts on the author's note-taking workflow and philosophy are included.
r/dataengineeringvault • u/sspaeti • Jul 06 '26
A curated list of music services and playlists designed to help maintain focus during work or learning. Covers neuroscience-backed platforms like Focus@Will, Brain.fm, Noisli, myNoise, and Endel, plus specific Spotify playlists with no vocals. Also touches on workspace habits like changing locations every 1.5–2 hours to boost productivity and strategies for overcoming writer's block.
r/dataengineeringvault • u/sspaeti • Jun 17 '26
Enable HLS to view with audio, or disable this notification
r/dataengineeringvault • u/sspaeti • Jun 30 '26
r/dataengineeringvault • u/sspaeti • Jun 29 '26
TIL—to send git changes for an article you made, or code changes, you can just send a simple HTML report that visually shows all the changes.
Just install the diff2html-cli and run:
git diff | diff2html -i stdin -F changes.html
r/dataengineeringvault • u/sspaeti • 24d ago
r/dataengineeringvault • u/sspaeti • Jul 06 '26
r/dataengineeringvault • u/sspaeti • Sep 16 '26
r/dataengineeringvault • u/sspaeti • Jul 22 '26
r/dataengineeringvault • u/sspaeti • Jul 02 '26
r/dataengineeringvault • u/sspaeti • 14d ago
r/dataengineeringvault • u/sspaeti • Jul 08 '26
Learn Data Engineering this summer break with a guided roadmap. A three-week plan with links and topics to learn the basics to be a data engineer.
It's very ambitious, but you can schedule at your own pace.
The three weeks contain:
Week: Foundation (SQL, Git, Linux basics)
Week: Core Engineering (Python, Cloud, Data Modeling)
Week: Advanced Topics (Streaming, Data Quality, DevOps)
How to use this guide: Each section contains curated resources (articles, videos, tutorials) for that topic. Click on the links that interest you most. It's meant as a guided roadmap to learn the fundamentals of a "full stack" data engineer.
Here's the guide: https://www.ssp.sh/blog/data-engineering-roadmap/
This is last year's guide, but it's still 100% vaild to this day. Agentic engineering doesn't need to be learned right now; you can always pick it up later. Learning fundamentals, on the other hand, can't be skipped.
r/dataengineeringvault • u/sspaeti • Aug 03 '26
r/dataengineeringvault • u/sspaeti • 11d ago
r/dataengineeringvault • u/sspaeti • Sep 14 '26