Skip to content

Conversation

tswast
Copy link
Collaborator

@tswast tswast commented Mar 27, 2024

Test with a minimum version of pyarrow to confirm compatibility.

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

🦕

Test with a minimum version of pyarrow to confirm compatibility.
@tswast tswast requested review from a team as code owners March 27, 2024 16:32
@tswast tswast requested a review from milkshakeiii March 27, 2024 16:32
@product-auto-label product-auto-label bot added size: xs Pull request size is extra small. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Mar 27, 2024
@milkshakeiii milkshakeiii added the automerge Merge the pull request once unit tests and other checks pass. label Mar 27, 2024
@@ -12,6 +12,7 @@ google-cloud-resource-manager==1.10.3
google-cloud-storage==2.0.0
ibis-framework==8.0.0
pandas==1.5.0
pyarrow==3.0.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can this be higher? looks like
E AttributeError: type object 'pyarrow.lib.RecordBatch' has no attribute 'from_pydict'
is due to 3.0.0 being too old

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Work-in-progress. I need to determine what our minimum version actually is. Will update this PR with a bit of a binary search to determine.

@milkshakeiii milkshakeiii removed the automerge Merge the pull request once unit tests and other checks pass. label Mar 27, 2024
@product-auto-label product-auto-label bot added size: s Pull request size is small. and removed size: xs Pull request size is extra small. labels Mar 27, 2024
@tswast tswast merged commit 9b1525a into main Mar 27, 2024
@tswast tswast deleted the tswast-pyarrow branch March 27, 2024 21:30
Genesis929 pushed a commit that referenced this pull request Apr 9, 2024
* deps: include `pyarrow` as a dependency

Test with a minimum version of pyarrow to confirm compatibility.

* fix unit test

* fix unit tests

* try pyarrow 11

* try pyarrow 8

* skip failing astype test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: s Pull request size is small.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants