Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Improve casting performance. #5639

Open
3 of 6 tasks
nvdbaranec opened this issue May 25, 2022 · 0 comments
Open
3 of 6 tasks

[FEA] Improve casting performance. #5639

nvdbaranec opened this issue May 25, 2022 · 0 comments
Assignees
@nvdbaranec
Labels
performance A performance related task/issue

Comments

@nvdbaranec
Copy link
Collaborator

nvdbaranec commented May 25, 2022 •
edited by hyperbolic2346

The casting code in the plugin is currently a collection of expensive string manipulation functionality (regex, etc). It exists to handle more exotic edge cases coming from CSV and JSON that don't work correctly in cudf itself. Ideally, these conversions could be done as a set of custom kernels directly in the spark-rapids-jni.

Tasks

Related items:
#4969
#4837
@nvdbaranec nvdbaranec added feature request New feature or request ? - Needs Triage Need team to review and classify labels May 25, 2022
@mattahrens mattahrens added the performance A performance related task/issue label May 31, 2022
@sameerz sameerz removed feature request New feature or request ? - Needs Triage Need team to review and classify labels May 31, 2022
@hyperbolic2346 hyperbolic2346 mentioned this issue Aug 2, 2022
Closed
This was referenced Oct 12, 2022
Merged
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nvdbaranec nvdbaranec

Labels
performance A performance related task/issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mattahrens @sameerz @nvdbaranec