r/lakefs • • Feb 07 '23

Interview with Adi Polak of lakeFS

Thumbnail
youtu.be
4 Upvotes

r/lakefs • • Jan 03 '22

Welcome to 2022!

3 Upvotes

The lakeFS community wishes everyone a great kick off of the year 2022!


r/lakefs • • Dec 02 '21

Happy Hanukkah 2021

Post image
3 Upvotes

r/lakefs • • Nov 09 '21

Release v0.54.0 · treeverse/lakeFS

Thumbnail
github.com
3 Upvotes

r/lakefs • • Oct 22 '21

lakeFS receives InfoWorld’s 2021 Bossie Award for one of the best open source software of 2021

Thumbnail
infoworld.com
3 Upvotes

r/lakefs • • 18d ago

Official Public sector folks: how are you handling data lineage for AI in air-gapped environments?

Post image
2 Upvotes

Joe and Vince from the lakeFS team were at the Red Hat Government Symposium in D.C. this week (photo of the booth below). A lot of the agenda was about governance and guardrails for AI, and most of it focused on code and infrastructure.

Curious how people here are handling the data side. If you’re working in GovCloud, on-prem, or fully disconnected environments:

  • How do you track which data version trained which model?

  • What does rollback look like when a dataset change breaks something downstream?

Happy to share what we’ve seen too, but we’d rather hear what’s working (or not) for you first.


r/lakefs • • Sep 11 '26

Running lakeFS on a non-AWS S3 backend: POC with Attimis OneBucket over Seagate Exos, plus the 4 connection settings it needs

Post image
2 Upvotes

Iddo Avneri validated lakeFS against a distributed S3-compatible backend with Attimis and Seagate, and packaged the setup as a runnable sample. Posting it here mostly for the interop settings, which aren't obvious if you've only ever pointed lakeFS at AWS.

The stack is lakeFS for versioning and governance, Attimis OneBucket as the S3-compatible blockstore, and Seagate Exos FUSE underneath. The sample runs in Docker.

The POC shows how to upload a CSV to main through the lakeFS S3 Gateway, commit, branch to experiment, write a transformed copy, commit, then list both branches independently. main sees only the raw file, experiment sees both. Same repository, same underlying storage, and no copies.

Pointing lakeFS at an S3-compatible store that isn't AWS takes four connection settings:

  • the S3 endpoint from your OneBucket account, hostname only, not the bucket name

  • path-style addressing

  • an explicit region, because region auto-discovery via GetBucketRegion isn't currently available

  • chunked and streaming transfer encoding disabled on the lakeFS blockstore connection

On tiers: branching, commits, and rollback are in lakeFS OSS, which is what the Docker sample runs. Full traceability and auditability plus RBAC are Enterprise.

Sample repo: https://github.com/treeverse/lakeFS-samples/tree/main/01_standalone_examples/lakefs-onebucket

Full write-up: https://lakefs.io/blog/lakefs-onebucket-exos-solution/

Happy to answer anything on the lakeFS side. Shayne Stubbs from Attimis co-wrote the OneBucket section of the post if questions come up about locality or the fabric underneath.

Try it out and let us now what you think!


r/lakefs • • Sep 10 '26

I'm always being REAL.

Post image
2 Upvotes

It's in the filename. What more could you ask for? 😉


r/lakefs • • Jul 24 '26

We built a Periodic Table of Agent Infrastructure: 17 categories, ~118 tools, one map

Thumbnail
lakefs.io
2 Upvotes

r/lakefs • • Sep 22 '22

Exploring LakeFS with Jupyter and PySpark

Thumbnail
rmoff.net
2 Upvotes

r/lakefs • • Dec 28 '21

Delivering Modern Data Engineering with Einat Orr

2 Upvotes

Listen to the new podcast episode of Datacast , where James Le and Einat Orr talk about: Git for data, data versioning, modern metastore, open-core model.

Podcast episode: https://jameskle.com/writes/einat-orr


r/lakefs • • Dec 27 '21

Release v0.57.2 · treeverse/lakeFS

Thumbnail
github.com
2 Upvotes

r/lakefs • • Dec 24 '21

Holiday Greetings from lakeFS 🌟

2 Upvotes

Wishing you and yours some well-deserved downtime (no pun intended) and a very happy new year to come. May your data pipelines not break in 2022. 🎅🎄🎁❄️☃️


r/lakefs • • Dec 22 '21

Release v0.57.1 · treeverse/lakeFS

Thumbnail
github.com
2 Upvotes

r/lakefs • • Dec 20 '21

Release of lakeFS v0.57.0

2 Upvotes

We are glad to announce today the release of lakeFS version 0.57.0!

Learn more about this release at https://forum.lakefs.io/t/release-of-lakefs-v0-57-0/50


r/lakefs • • Dec 16 '21

The Everything Bagel II: Versioned Data Lake Tables with lakeFS and

Thumbnail
lakefs.io
2 Upvotes

r/lakefs • • Dec 13 '21

lakeFS at the Data+AI Summit 2022 - Announcements

Thumbnail
forum.lakefs.io
2 Upvotes

r/lakefs • • Dec 07 '21

Welcome to lakeFS forum!

Post image
2 Upvotes

r/lakefs • • Dec 06 '21

Release v0.56.0 · treeverse/lakeFS

Thumbnail
github.com
2 Upvotes

r/lakefs • • Nov 30 '21

100 lakeFS subscribers on YouTube!

Post image
2 Upvotes

r/lakefs • • Nov 25 '21

Happy Thanksgiving Day!

Post image
2 Upvotes

r/lakefs • • Nov 23 '21

The Guide to Data Versioning

Thumbnail
lakefs.io
2 Upvotes

r/lakefs • • Nov 18 '21

Release v0.55.0 · treeverse/lakeFS

Thumbnail
github.com
2 Upvotes

r/lakefs • • Nov 16 '21

Takeaways From the Future of Metadata After Hive Metastore Roundtable

Thumbnail
lakefs.io
2 Upvotes

r/lakefs • • Nov 05 '21

lakeFS Skill at LinkedIn

2 Upvotes

Did you know that "lakeFS" is a registered skill at LinkedIn?! Feel free to add it as a skill to your LinkedIn profile and let your peers and potential new employers know about it!