Out of Memory Error when trying to convert column from ms to TIMESTAMP using epoch_ms

[anchit-sadana]

What happens?

Using epoch_ms(column) gives duckdb.duckdb.OutOfMemoryException: Out of Memory Error: failed to allocate data of size 8.0 GiB (8.0 GiB/11.1 GiB used)

To Reproduce

SET memory_limit = '12gb';
ALTER TABLE solusdtp_book_ticker
ADD COLUMN temp_transaction_datetime TIMESTAMP;

-- Populate the new column with converted datetime values
UPDATE solusdtp_book_ticker
SET temp_transaction_datetime = epoch_ms(transaction_time);

where solusdtp_book_ticker is a sufficiently large dataset

OS:

ubuntu22.04 lts aarch64

DuckDB Version:

0.10

DuckDB Client:

Python

Full Name:

Anchit Sadana

Affiliation:

MazuCap

What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.

I have tested with a stable release

Did you include all relevant data sets for reproducing the issue?

No - I cannot easily share my data sets due to their large size

Did you include all code required to reproduce the issue?

• Yes, I have

Did you include all relevant configuration (e.g., CPU architecture, Python version, Linux distribution) to reproduce the issue?

• Yes, I have

[github-actions]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 30 days.