You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, load_table doesn't support passing a pyarrow RecordBatch. RecordBatch can be converted to a pandas dataframe using .to_pandas(), so it seems trivial to support this as well.
Related #185 : In theory, this is supposed to work with load_table_arrow, but it doesn't work with load_table(method='arrow')
The text was updated successfully, but these errors were encountered:
data=<pyarrow.lib.RecordBatchobjectat0x7f6bfa17f098>, preserve_index=Falsedefbuild_row_desc(data, preserve_index=False):
ifnotisinstance(data, pd.DataFrame):
# Once https://issues.apache.org/jira/browse/ARROW-1576 is complete# we can support pa.Table here tooraiseTypeError("Create table is not supported for type {}. ""Use a pandas DataFrame, or perform the create ">"separately".format(type(data)))
ETypeError: Createtableisnotsupportedfortype<class'pyarrow.lib.RecordBatch'>. UseapandasDataFrame, orperformthecreateseparatelypymapd/_pandas_loaders.py:197: TypeError
randyzwitch
changed the title
Support pyarrow RecordBatch for upload
Support pyarrow RecordBatch and Table for upload
Apr 10, 2019
randyzwitch
changed the title
Support pyarrow RecordBatch and Table for upload
Support pyarrow RecordBatch and Table in main load_table function
Apr 12, 2019
Currently, load_table doesn't support passing a pyarrow RecordBatch. RecordBatch can be converted to a pandas dataframe using
.to_pandas()
, so it seems trivial to support this as well.Related #185 : In theory, this is supposed to work with
load_table_arrow
, but it doesn't work withload_table(method='arrow')
The text was updated successfully, but these errors were encountered: