BIGINT from Oracle are truncated to 2147483647

[DATA2PLAYvf]

1. What versions are you using? 3.3.0
   Give your Oracle Database version, e.g.: 19.22.0.0.0
   Give your Oracle Client version (if you are using Thick mode): (19, 6, 0, 0, 0)

platform.platform: Windows-2022Server-10.0.20348-SP0
sys.maxsize > 2**32: True
platform.python_version: 3.12.10

oracledb.version: 3.3.0

2. Is it an error or a hang or a crash?
   An error (I think, maybe I did something wrong !)

3. What error(s) or behavior you are seeing?
   For an Oracle NUMBER(15), I don't get good numbers on pyarrow side

4. Does your application call init_oracle_client()?
   I use thick mode

5. Include a runnable Python script that shows the problem.

SQL

CREATE TABLE test_bigint (
    my_value NUMBER(15)
);

INSERT INTO test_bigint (my_value)
VALUES (250000193647634);

COMMIT;

PYTHON

# load oracle data into polars (it is the same with pandas)
odf = conn.fetch_df_all(statement="select * from test_bigint")
pl.from_arrow(odf)

Log :
shape: (1, 1)
MY_VALUE
i64
2147483647

Everything is fine without using ODF

[cjbj]

We couldn't reproduce on Linux with our current (internal) dev code. We'll do some more testing.

@DATA2PLAYvf what exactly do you mean "Everything is fine without using ODF"? What's this alternative code?

[DATA2PLAYvf]

Before "Oracle Data frame" I used this :

polars :
df = pl.read_database(query=sql, connection=cursor)

pandas :
cursor.execute(sql)
df = pd.DataFrame.from_records(cursor.fetchall())

To complete, here a test with thin mode, result is also bad.

import oracledb
import polars as pl

# Thin mode
conn = oracledb.connect(
    user="myuser",
    password="****",
    dsn="****"
)

# good
cur = conn.cursor()
cur.execute("SELECT * FROM test_bigint")
print(f'Good : {cur.fetchone()}')


# bad
odf = conn.fetch_df_all(statement="select * from test_bigint")
print(f'bad : {pl.from_arrow(odf)}')

conn.close()

Result :
Good : (250000193647634,)
bad : shape: (1, 1)
┌────────────┐
│ MY_VALUE │
│ --- │
│ i64 │
╞════════════╡
│ 2147483647 │
└────────────┘

[anthony-tuininga]

I have pushed a patch that should correct this issue and have initated a build from which you can download pre-built development wheels once it completes. You can also build from source if you prefer. If you can test your scenario and confirm the patch works as expected, that would be appreciated!

[DATA2PLAYvf]

Hello @anthony-tuininga ,

Perfect, it's fixed now. Tested with oracledb-3.4.0b1-cp312-cp312-win_amd64.whl

So I'll wait the 3.4.0 prod.

Thanks a lot

[cjbj]

@DATA2PLAYvf thanks for the confirmation.

[anthony-tuininga]

This was included in python-oracledb 3.4.0 which was just released.