feat!: bump polars to unreleased 2023-12-21 version

[eitsupi]

It references the same commit as py-polars 0.20.0 0.20.2.

I've been busy lately so I don't know if I'll be able to finish this, but I'd like to finish this and create a new release if possible.

[etiennebacher]

Can we wait for rust-polars 0.36? It is just easier to bump when there's a changelog for Rust-polars and we always bumped Rust versions when there was a rust-polars release.

I can ask on discord when they plan to release 0.36

[eitsupi]

It's okay to wait, but since we don't know when it will be released, I thought it might be a good idea to release it with what we have now.

@stinodego Are there any plans for the next release of Rust-polars?
I'm also curious about whether or not you intend to update the version of rust-polars to 1.0.0. (The discussion looks mostly like py-polars' stuff and I have a feeling that rust-polars won't make it to 1.0.0)

[stinodego]

1.0.0 for Rust Polars is a long way off. It will definitely not coincide with 1.0.0 for Python Polars.

I'm not sure when 0.36 comes out. The release cadence for Rust Polars is basically whenever Ritchie decides to press the button 😄

[etiennebacher]

Thanks @stinodego :) @ritchie46 do you already have a date in mind (or an estimation)?

[eitsupi]

I saw compile errors from these PRs.

• feat! raise on not supported aggregates polars#13043
• feat: warn if by column is not sorted in rolling aggregations (as opposed to raising), add warn_if_unsorted argument polars#12398
• depr(python,rust!): Rename str.json_extract to str.json_decode polars#12586
• feat(python,rust): Move categorical ordering into dtype polars#12911
• feat: Implement support for multi-character comments in read_csv polars#12519
• feat(rust)!: Rename frame_equal/series_equal to equals polars#12663
• feat!: Preserve left and right join keys in outer joins polars#12963
• perf: Improve rolling_median algorithm polars#12704

[eitsupi]

I have fixed as many of the problems as I can but it is not complete yet.
Unfortunately I don't have any more time this week so it would be great if someone could finish this.

[etiennebacher]

I'll work on this on Friday, maybe before. It would be amazing if rust-polars was bumped in the meantime but I'll continue this anyway

[eitsupi]

I don't think the error in the describe example is directly related to this PR; describe in py-polars is written in python, which needs to be ported to R.
New issue #614

[etiennebacher]

We can use mtcars instead of iris in the example to circumvent this temporarily.

[eitsupi]

The state of sink_csv is strange, but I don't know what's causing it.
In my local case, when I run sink_csv to a tempfile(), the R session freezes with the CSV left in an incomplete state.

library(polars)
temp_out <- tempfile()
pl$LazyFrame(mtcars)$sink_csv(temp_out)

[eitsupi]

Strangely, it doesn't freeze when I give a string to the path argument.

library(polars)
temp_out = tempfile()
temp_out
#> [1] "/tmp/RtmpXe0CL2/file3d5d188b4813"
pl$DataFrame(mtcars)$lazy()$sink_csv("/tmp/RtmpXe0CL2/file3d5d188b4813")
pl$DataFrame(mtcars)$lazy()$sink_csv(temp_out)

Edit: Ah, sorry, now I know the cause. If I try to write to the same path a second time it freezes.
The exact same thing happens with py-polars.

[etiennebacher]

Thanks a lot @eitsupi, great work! I have minor comments but also I came across some weird panics when I tried to update results of rollbench so I'd like to ensure this is upstream and not on the R side.

[etiennebacher]

cool hack, nice to get rid of all these duplicated docs

[eitsupi]

I thinks this is related to #560 and the function name should be pl_read_csv.
This function should be add to the pl environment when loading.

[etiennebacher]

Can't reproduce the panics in rollbench code, so fine for me

[etiennebacher]

Also should we bump the r-polars version in cargo.toml?

[etiennebacher]

I added $replace() which should be fine to do here since it was rewritten in py-polars 0.20.2 (so it fits the objective of this PR)

[eitsupi]

Thanks for updates, @etiennebacher.

[eitsupi]

Also should we bump the r-polars version in cargo.toml?

The current version has never been released, so the same number is fine.