Update pyarrow version, use pyarrow backend for pandas

[amrit110]

PR Type ([Feature | Fix | Documentation | Test])

Update

Short Description

• Update pyarrow version, also use pyarrow backend as default for pandas

Tests Added

...

[amrit110]

@fcogidi, I've switched to using pyarrow backend for pandas. In the cyclops-query tool, i also set the default backend of the pandas df returned to be pyarrow. This caused some errors in the tests. Can you please take a look? I want to migrate to using pyarrow backend since that would make the dataframe easily convertible between dataframe libraries and also into HF dataset.

[fcogidi]

@fcogidi, I've switched to using pyarrow backend for pandas. In the cyclops-query tool, i also set the default backend of the pandas df returned to be pyarrow. This caused some errors in the tests. Can you please take a look? I want to migrate to using pyarrow backend since that would make the dataframe easily convertible between dataframe libraries and also into HF dataset.

I'll take a look.

[codecov]

Codecov Report

Merging #513 (3399546) into main (b4a94c6) will increase coverage by 0.00%.
The diff coverage is 100.00%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #513   +/-   ##
=======================================
  Coverage   64.21%   64.21%           
=======================================
  Files          94       94           
  Lines        9302     9303    +1     
=======================================
+ Hits         5973     5974    +1     
  Misses       3329     3329           

Files	Coverage Δ
cyclops/data/slicer.py	85.77% <100.00%> (+0.06%)	⬆️
cyclops/process/feature/handle_types.py	79.91% <100.00%> (ø)