-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[C++] CSV writer's WriteTable
failed with: Failed casting from large_string to string: input array too large
#40270
Comments
pitrou
added a commit
that referenced
this issue
Apr 11, 2024
…to CSV (#40271) ### Rationale for this change Avoid casting failures when tables contains too long large string arrays. ### What changes are included in this PR? Replace the usage of `StringArray` to `LargeStringArray`. ### Are these changes tested? No extra test case is needed (as it is to fix some corner cases). ### Are there any user-facing changes? No user-facing changes. * GitHub Issue: #40270 Lead-authored-by: Tao He <sighingnow@gmail.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Co-authored-by: Antoine Pitrou <pitrou@free.fr> Signed-off-by: Antoine Pitrou <antoine@python.org>
Issue resolved by pull request 40271 |
vibhatha
pushed a commit
to vibhatha/arrow
that referenced
this issue
Apr 15, 2024
…ables to CSV (apache#40271) ### Rationale for this change Avoid casting failures when tables contains too long large string arrays. ### What changes are included in this PR? Replace the usage of `StringArray` to `LargeStringArray`. ### Are these changes tested? No extra test case is needed (as it is to fix some corner cases). ### Are there any user-facing changes? No user-facing changes. * GitHub Issue: apache#40270 Lead-authored-by: Tao He <sighingnow@gmail.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Co-authored-by: Antoine Pitrou <pitrou@free.fr> Signed-off-by: Antoine Pitrou <antoine@python.org>
tolleybot
pushed a commit
to tmct/arrow
that referenced
this issue
May 2, 2024
…ables to CSV (apache#40271) ### Rationale for this change Avoid casting failures when tables contains too long large string arrays. ### What changes are included in this PR? Replace the usage of `StringArray` to `LargeStringArray`. ### Are these changes tested? No extra test case is needed (as it is to fix some corner cases). ### Are there any user-facing changes? No user-facing changes. * GitHub Issue: apache#40270 Lead-authored-by: Tao He <sighingnow@gmail.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Co-authored-by: Antoine Pitrou <pitrou@free.fr> Signed-off-by: Antoine Pitrou <antoine@python.org>
vibhatha
pushed a commit
to vibhatha/arrow
that referenced
this issue
May 25, 2024
…ables to CSV (apache#40271) ### Rationale for this change Avoid casting failures when tables contains too long large string arrays. ### What changes are included in this PR? Replace the usage of `StringArray` to `LargeStringArray`. ### Are these changes tested? No extra test case is needed (as it is to fix some corner cases). ### Are there any user-facing changes? No user-facing changes. * GitHub Issue: apache#40270 Lead-authored-by: Tao He <sighingnow@gmail.com> Co-authored-by: Antoine Pitrou <antoine@python.org> Co-authored-by: Antoine Pitrou <pitrou@free.fr> Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug, including details regarding any error messages, version, and platform.
For tables which contains
arrow::LargeStringArray
which further contains long string elements, the following code:failed with the error:
Failed casting from large_string to string: input array too large
.Component(s)
C++
The text was updated successfully, but these errors were encountered: