[skip ci] pip(deps): Bump pyarrow from 8.0.0 to 10.0.0 #1731
Conversation
![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?s=60&v=4){kind=small}
Bumps [pyarrow](https://github.com/apache/arrow) from 8.0.0 to 10.0.0. - [Release notes](https://github.com/apache/arrow/releases) - [Commits](apache/arrow@go/v8.0.0...go/v10.0.0) --- updated-dependencies: - dependency-name: pyarrow dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
dependabot
bot
added
the
dependencies
|
Hi everyone, how are you? I'm depends on this PR, do you on when it will be possible to merge? @kukushking @jaidisido @cnfait @LeonLuttenberger Thank you! 🙏 |
|
Hi @l-jhon - thanks for opening this! We're currently working on sdk for pandas 3.0 that supports distributed data frames using ray and modin. In that version at this point we're limited to pyarrow < 8 (by ray). We'll have to support both based on if the user intends to use ray or not. For this PR, I am ok with the upgrade to 10 in main but we'll have to revise this when 3.0 is out. |
|
FYI kicked off the tests. |
This comment was marked as outdated.
This comment was marked as outdated.
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
|
Looks like |
| @@ -52,6 +52,9 @@ def _new_writer( | |||
| pyarrow_additional_kwargs["coerce_timestamps"] = "ms" | |||
| if "flavor" not in pyarrow_additional_kwargs: | |||
| pyarrow_additional_kwargs["flavor"] = "spark" | |||
| if "version" not in pyarrow_additional_kwargs: | |||
| # By default, use version 1.0 logical type set to maximize compatibility | |||
| pyarrow_additional_kwargs["version"] = "1.0" | |||
There was a problem hiding this comment.
We may revise this in 3.0.0
This comment was marked as outdated.
This comment was marked as outdated.
kukushking
requested review from
jaidisido,
malachi-constant and
LeonLuttenberger
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
|
@malachi-constant yes those two timestream tests have been very flaky lately. We should be all right with this PR though. |
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
|
Thank you so much, everyone! :D |
Bumps pyarrow from 8.0.0 to 10.0.0.
Commits
89f9a09MINOR: [Release] Update versions for 10.0.0cb64545MINOR: [Release] Update .deb/.rpm changelogs for 10.0.06776681MINOR: [Release] Update CHANGELOG.md for 10.0.0c81588eARROW-17954: [R] Update news for 10.0 (#14337)a12fce7ARROW-17317: [Release][Docs] Normalize previous document version directory (#...7d4bc9bARROW-18103: [Packaging][deb][RPM] Fix upload artifacts patterns (#14462)6278176ARROW-17891: [Docs][Python] Update and sync Win section of the developers/pyt...8f03259ARROW-17353: [Release][R] Validate binaries version (#14396)a735316ARROW-18083: [C++] Bump vendored zlib version (#14446)eea4a54ARROW-17524: [C++] Correction for fields included when reading an ORC table (...Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot mergewill merge this PR after your CI passes on it@dependabot squash and mergewill squash and merge this PR after your CI passes on it@dependabot cancel mergewill cancel a previously requested merge and block automerging@dependabot reopenwill reopen this PR if it is closed@dependabot closewill close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot ignore this major versionwill close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor versionwill close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependencywill close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)