Is it possible to special case ldf.sort(pl.col("a").over("b")) so that it works with streaming?

[kszlim]

Description

Specifically so that:

ldf = pl.LazyFrame({"a": [1,2,3,2,1,5,6], "b": [1,1,1,1,2,2,2]})
ldf = ldf.sort(pl.col("a").over("b"))
ldf.collect(streaming=True)

Could work fully streaming.

It has better runtime and memory properties in general if feasible.

[kszlim]

Actually that doesn't seem to do what I desire either.

I'm hoping to get something like:

pl.LazyFrame({"a": [1,2,2,3,1,5,6], "b": [1,1,1,1,2,2,2]}

[kszlim]

Instead:

ldf.select(pl.all().sort_by("a").over("b")).collect()

Seems to do what i want, but without working in a streaming context.

[ritchie46]

Not yet, we are working on the architecture to do more of the expression API streaming. But this requires some patience. There is a lot of pre-work to be done.