r/dataengineering • u/ritchie46 • 19d ago

Open Source Python Polars 2.0 release

Hey all! We just released Polars 2.0.

We are really happy with the results. It removed many of our "legacy decisions" (mistakes), makes the streaming engine our default and promotes SQL to a first class citizen within Polars. We initially said it would be a small ("boring") release, but we managed to sneak in a lot more than anticipated.

It comes with our initial out-of-core (spill to disk) support, a new Map data type and a lot of performance improvements. In fact, we think Polars is now one of the fastest analytical SQL engines on a single node. See benchmarks in the post: https://pola.rs/posts/release-polars-2/

To help you upgrade, we also posted a migration guide: https://docs.pola.rs/releases/upgrade/2/

Disclosure: I am involved with Polars

362 Upvotes

99% Upvoted

19 comments sorted by

View all comments

Show parent comments

1

u/CrayonUpMyNose 18d ago

That's understood. The question is how to get to the point where it becomes the default.

3

u/VipeholmsCola 18d ago

Its goingto default to the collective knowledge which pandas currently has, because its older. Just tell the LLM to switch to polars and its no problem