Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PanicException creating DataFrame with numpy array inside dict #16477

Closed
2 tasks done
cmdlineluser opened this issue May 24, 2024 · 1 comment
Closed
2 tasks done

PanicException creating DataFrame with numpy array inside dict #16477

cmdlineluser opened this issue May 24, 2024 · 1 comment
Labels
bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars

Comments

@cmdlineluser
Copy link
Contributor

cmdlineluser commented May 24, 2024

Checks

  • I have checked that this issue has not already been reported.
  • I have confirmed this bug exists on the latest version of Polars.

Reproducible example

import polars as pl
import numpy as np

pl.DataFrame({'A': [{'B': np.array([1])}]})

Log output

thread '<unnamed>' panicked at crates/polars-core/src/chunked_array/ops/any_value.rs:124:75:
PanicException: called `Option::unwrap()` on a `None` value

Issue description

Works without the numpy array

>>> pl.DataFrame({'A': [{'B': [1]}]})
shape: (1, 1)
┌───────────┐
│ A         │
│ ---       │
│ struct[1] │
╞═══════════╡
│ {[1]}     │
└───────────┘

Or without the dict:

>>> pl.DataFrame({'A': [np.array([1])]})
shape: (1, 1)
┌───────────┐
│ A         │
│ ---       │
│ list[i64] │
╞═══════════╡
│ [1]       │
└───────────┘

Expected behavior

No panic.

Installed versions

--------Version info---------
Polars:               0.20.29
Index type:           UInt32
Platform:             macOS-13.6.1-arm64-arm-64bit
Python:               3.12.2 (main, Feb  6 2024, 20:19:44) [Clang 15.0.0 (clang-1500.1.0.2.5)]

----Optional dependencies----
adbc_driver_manager:  <not installed>
cloudpickle:          <not installed>
connectorx:           <not installed>
deltalake:            <not installed>
fastexcel:            <not installed>
fsspec:               <not installed>
gevent:               <not installed>
hvplot:               <not installed>
matplotlib:           <not installed>
nest_asyncio:         <not installed>
numpy:                1.26.4
openpyxl:             <not installed>
pandas:               2.2.1
pyarrow:              15.0.2
pydantic:             <not installed>
pyiceberg:            <not installed>
pyxlsb:               <not installed>
sqlalchemy:           <not installed>
xlsx2csv:             <not installed>
xlsxwriter:           <not installed>
@cmdlineluser cmdlineluser added bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars labels May 24, 2024
@cmdlineluser cmdlineluser changed the title PanicException creating DataFrame from numpy array inside dict PanicException creating DataFrame with numpy array inside dict May 24, 2024
@cmdlineluser
Copy link
Contributor Author

This is actually now fixed on main thanks to the new ndarray/tensor support. #16466

>>> pl.DataFrame({'A': [{'B': np.array([1])}]})
shape: (1, 1)
┌───────────┐
│ A         │
│ ---       │
│ struct[1] │
╞═══════════╡
│ {1.0}     │
└───────────┘

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars
Projects
None yet
Development

No branches or pull requests

1 participant