You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm hitting this from data coming from Spark while retrieving this data frame:
<database> <name> <temp>
defaultaTRUEbTRUE
Error:
error: Failedtofetchdata: invaliddatainbuffer2
The problem is that is possible to have a NULL character array with offsets set to 0, notice that in the example above Spark returns two batches, so effectively, we are trying to parse:
<database> <name> <temp>
bTRUE
Where the data array is NULL and the offsets 0s for the columns.
Here is a snapshot while debugging StringArray_to_Vector:
I'm hitting this from data coming from Spark while retrieving this data frame:
Error:
The problem is that is possible to have a NULL character array with offsets set to 0, notice that in the example above Spark returns two batches, so effectively, we are trying to parse:
Where the data array is NULL and the offsets 0s for the columns.
Here is a snapshot while debugging StringArray_to_Vector:
Reporter: Javier Luraschi / @javierluraschi
Assignee: Romain Francois / @romainfrancois
Original Issue Attachments:
PRs and other links:
Note: This issue was originally created as ARROW-3693. Please see the migration documentation for further details.
The text was updated successfully, but these errors were encountered: