Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[C++] Improve UTF8 validation speed and CSV string conversion #26304

Closed
asfimport opened this issue Oct 15, 2020 · 1 comment
Closed

[C++] Improve UTF8 validation speed and CSV string conversion #26304

asfimport opened this issue Oct 15, 2020 · 1 comment
Assignees
@pitrou
Labels
Component: C++ Type: enhancement
Milestone
3.0.0

Comments

@asfimport
Copy link
Collaborator

asfimport commented Oct 15, 2020 •
edited
Loading

Based on profiling from ARROW-10308, UTF8 validation is a bottleneck of CSV string conversion.

This is because we must validate many small UTF8 strings individually.

Reporter: Antoine Pitrou / @pitrou
Assignee: Antoine Pitrou / @pitrou

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-10313. Please see the migration documentation for further details.
@asfimport
Copy link
Collaborator Author

Antoine Pitrou / @pitrou:
Issue resolved by pull request 8470
#8470

@asfimport asfimport added this to the 3.0.0 milestone Jan 11, 2023
@asfimport asfimport mentioned this issue Jan 11, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pitrou pitrou

Labels
Component: C++ Type: enhancement
Projects
None yet
Milestone
3.0.0
Development

No branches or pull requests
2 participants
@pitrou @asfimport