python polars 64 release (#3059)

.github/deploy_manylinux.sh

@@ -9,6 +9,17 @@ cp README.md py-polars/README.md
 cd py-polars
 rustup override set nightly-2022-03-23
 export RUSTFLAGS='-C target-feature=+fxsr,+sse,+sse2,+sse3,+ssse3,+sse4.1+sse4.2,+popcnt,+avx,+fma'
+
+# first the default release
+maturin publish \
+  --skip-existing \
+  --username ritchie46
+
+# now compile polars with bigidx feature
+sed -i 's/name = "polars"/name = "polars-64"/' pyproject.toml
+# a brittle hack to insert the 'bigidx' feature
+sed '/s/"dynamic_groupby",/"dynamic_groupby",\n"bigidx",/' Cargo.toml
+
 maturin publish \
   --skip-existing \
   --username ritchie46

README.md

@@ -93,17 +93,11 @@ See the results in [h2oai's db-benchmark](https://h2oai.github.io/db-benchmark/)
 
 Install the latest polars version with:
 
-```
-$ pip3 install polars
-```
-
-Update existing polars installation to the lastest version with:
-
 ```
 $ pip3 install -U polars
 ```
 
-Releases happen quite often (weekly / every few days) at the moment, so updating polars regularily to get the latest bugfixes / features might not be a bad idea.
+Releases happen quite often (weekly / every few days) at the moment, so updating polars regularly to get the latest bugfixes / features might not be a bad idea.
 
 
 ## Rust setup
@@ -180,6 +174,13 @@ Arrow2 also has a more granular code base, helping to reduce the compiler bloat.
 ## Use custom Rust function in python?
 See [this example](./examples/python_rust_compiled_function).
 
+# Going big...
+Do you expect more than `32^2` ~4,2 billion rows? Compile polars with the `bigidx` feature flag.
+
+Or for python users install `$ pip install -U polars-64`.
+
+Don't use this unless you hit the row boundary as the default polars is faster and consumes less memory.
+
 ## Acknowledgements
 
 Development of Polars is proudly powered by