Polars: Blazingly Fast DataFrames in Rust and Python

preview_player
Показать описание
This talk will introduce Polars a blazingly fast DataFrame library written in Rust on top of Apache Arrow. Its a DataFrame library that brings exploratory data analysis closer to the lessons learned in database research.

CPU's today's come with many cores and with their superscalar designs and SIMD registers allow for even more parallelism. Polars is written from the ground up to fully utilize the CPU's of this generation.

Besides blazingly fast algorithms, cache efficient memory layout and multi-threading, it consist of a lazy query engine, allowing Polars to do several optimizations that may improve query time and memory usage.

Read more:

Join the talk to learn more.

Connect with us:
Рекомендации по теме
Комментарии
Автор

Great video. I have been playing with Polars, Python, and Rust, and it is a fantastic technology.

Also, I think Polars' Python facade with Rust backend / clean API is a great model for other data-centric technologies that need performance and scripting facade interfaces.

Big thanks to the Polars team for this gem.

JeremyChone
Автор

Learn rust, python and rust synergies will be all over the place in data science soon. Great work with Polars

ControlTheGuh
Автор

Polars is just great! After trying it I won't go back to pandas.

АнатолийБугаков-ег
Автор

Haven't been so excited about data analysis for a while. Now comes the chore of converting pandas to polars in a 15k line project.

incremental_failure
Автор

For a lot of my job its not possible to use eagerly evaluated DFs, polars is a fantastic option.

Josh-wbii
Автор

Really great crate and great video, thanks.

saaddahmani
Автор

This is great, can we use polars on a databricks cluster?

headbangingidiot
Автор

I'm going to try this out. Thanks

swalsh
Автор

I wonder if this could ever be used with multiple machines similar to spark. Polars looks very fast and with the addition of distributed compute it would be very powerful. Perhaps it was not designed to allow that though.

milo
Автор

Super confused. I thought Polars was deprecating in favor of Arrow2?

samuelemmettbray
Автор

need pandas compatible api, just get fast conversion from pandas

hiongun