[Python] Conversion from datetime.datetime to timstamp('ns') can overflow

[asfimport]

In the python conversion of datetime scalars, there is no check for integer overflow:

In [32]: pa.array([datetime.datetime(3000, 1, 1)], pa.timestamp('ns'))                                                                                                                                             
Out[32]: 
<pyarrow.lib.TimestampArray object at 0x7f5bddec00a8>
[
  1830-11-23 00:50:52.580896768
]

So in case the target type has nanosecond unit, this can give wrong results (I don't think the other resolutions can reach overflow, given the limited range of years of datetime.datetime).

We should probably check for this case and raise an error.

Reporter: Joris Van den Bossche / @jorisvandenbossche

Related issues:

• [Python] Pyarrow allows for unsafe conversions of datetime objects to timestamp nanoseconds (is superceded by)

_{Note: This issue was originally created as ARROW-6779. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
It looks like you fixed this in ARROW-9768 :-)

[asfimport]

Todd Farmer / @toddfarmer:
Transitioning issue from Resolved to Closed to based on resolution field value.