Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cherry pick allow to read non-standard CSV to active_release #407

Merged
merged 1 commit into from
Jun 5, 2021

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jun 4, 2021

Automatic cherry-pick of 1d72b26

Resolves #394

* refactor Reader::from_reader

split into build_csv_reader, from_csv_reader
add escape, quote, terminator arg to build_csv_reader

* add escape,quote,terminator field to ReaderBuilder

schema inference support for non-standard CSV

  add fn infer_file_schema_with_csv_options
  add fn infer_reader_schema_with_csv_options

ReaderBuilder support for non-standard CSV

add escape, quote, terminator field
add fn with_escape, with_quote, with_terminator
change ReaderBuilder::build for non-standard CSV

* minimize API change

* add tests

add #[test] fn test_non_std_quote
add #[test] fn test_non_std_escape
add #[test] fn test_non_std_terminator

* apply cargo fmt
@codecov-commenter
Copy link

Codecov Report

Merging #407 (e846b7e) into active_release (cd95d7c) will increase coverage by 0.03%.
The diff coverage is 99.07%.

❗ Current head e846b7e differs from pull request most recent head 5168537. Consider uploading reports for the commit 5168537 to get more accurate results
Impacted file tree graph

@@                Coverage Diff                 @@
##           active_release     #407      +/-   ##
==================================================
+ Coverage           82.54%   82.58%   +0.03%     
==================================================
  Files                 162      162              
  Lines               44093    44194     +101     
==================================================
+ Hits                36398    36499     +101     
  Misses               7695     7695              
Impacted Files Coverage Δ
arrow/src/csv/reader.rs 89.91% <99.07%> (+1.54%) ⬆️
arrow/src/array/transform/boolean.rs 84.61% <0.00%> (+7.69%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cd95d7c...5168537. Read the comment docs.

@alamb alamb merged commit c928d57 into active_release Jun 5, 2021
@alamb alamb deleted the cherry_pick_1d72b262 branch June 5, 2021 13:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants