Segfault / capacity overflow caused by agg + concat_list + struct + quantile

[cmdlineluser]

Checks

• I have checked that this issue has not already been reported.
• I have confirmed this bug exists on the latest version of Polars.

Reproducible example

import polars as pl

df = pl.read_csv(b"""
group,value
1,0.1973209146402105
2,0.13380719982405365
1,0.6152394463707009
2,0.4558767896005155
""".strip())

df.group_by("group").agg(
   pl.concat_list(
      pl.struct(quantile=1, value=pl.col("value").quantile(1))
   )
)

Log output

file < 128 rows, no statistics determined
no. of chunks: 1 processed by: 1 threads.
keys/aggregates are not partitionable: running default HASH AGGREGATION
zsh: segmentation fault

Issue description

The example either segfaults or raises a PanicException

thread 'polars-1' panicked at library/alloc/src/raw_vec.rs:25:5:
capacity overflow

It seems to try and allocate massive amounts of memory.

Expected behavior

Run without error.

Installed versions

--------Version info---------
Polars:               0.20.22
Index type:           UInt32
Platform:             macOS-13.6.1-arm64-arm-64bit
Python:               3.12.2 (main, Feb  6 2024, 20:19:44) [Clang 15.0.0 (clang-1500.1.0.2.5)]

----Optional dependencies----
adbc_driver_manager:  <not installed>
cloudpickle:          <not installed>
connectorx:           <not installed>
deltalake:            <not installed>
fastexcel:            <not installed>
fsspec:               <not installed>
gevent:               <not installed>
hvplot:               <not installed>
matplotlib:           <not installed>
nest_asyncio:         <not installed>
numpy:                1.26.4
openpyxl:             <not installed>
pandas:               2.2.1
pyarrow:              15.0.2
pydantic:             <not installed>
pyiceberg:            <not installed>
pyxlsb:               <not installed>
sqlalchemy:           <not installed>
xlsx2csv:             <not installed>
xlsxwriter:           <not installed>