Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump Apache Arrow to 10.0.0 #1764

Merged
merged 4 commits into from
Dec 13, 2022
Merged

Bump Apache Arrow to 10.0.0 #1764

merged 4 commits into from
Dec 13, 2022

Conversation

Yicong-Huang
Copy link
Collaborator

@Yicong-Huang Yicong-Huang commented Dec 8, 2022 •
edited
Loading

This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

Java/Scala side:

  • JDBC Driver for Arrow Flight SQL (13800)
  • Initial implementation of immutable Table API (14316)
  • Substrait, transaction, cancellation for Flight SQL (13492)
  • Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory (13811, 13973, 14182)
  • Add utility to bind Arrow data to JDBC parameters (13589)

Python side:

  • The batch_readahead and fragment_readahead arguments for scanning Datasets are exposed in Python (ARROW-17299).
  • ExtensionArrays can now be created from a storage array through the pa.array(..) constructor (ARROW-17834).
  • Converting ListArrays containing ExtensionArray values to numpy or pandas works by falling back to the storage array (ARROW-17813).
  • Casting Tables to a new schema now honors the nullability flag in the target schema (ARROW-16651).

@Yicong-Huang Yicong-Huang self-assigned this Dec 8, 2022
@Yicong-Huang Yicong-Huang added the dependencies Pull requests that update a dependency file label Dec 8, 2022
@Yicong-Huang Yicong-Huang added this to In progress in Utilities via automation Dec 8, 2022
Utilities automation moved this from In progress to Review in progress Dec 12, 2022
@Yicong-Huang Yicong-Huang merged commit 2ff37bd into master Dec 13, 2022
@Yicong-Huang Yicong-Huang deleted the yicong-update-arrow-10 branch December 13, 2022 04:46
Utilities automation moved this from Review in progress to Done Dec 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zuozhiw zuozhiw zuozhiw approved these changes

Assignees

@Yicong-Huang Yicong-Huang

Labels
dependencies Pull requests that update a dependency file
Projects
No open projects
Utilities
  
Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@Yicong-Huang @zuozhiw