-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-2640, BEAM-2641] Introduces TextIO/AvroIO.read().withHintMatchesManyFiles() #3639
Conversation
Changes Unknown when pulling a3a4e86 on jkff:textio-readall into ** on apache:master**. |
Since #3615 was submitted, the current PR should be updated to include AvroIO.read().withHintMatchesManyFiles(). |
OK, now this also includes AvroIO.read().withHintMatchesManyFiles(), PTAL. |
Changes Unknown when pulling ff3adf3 on jkff:textio-readall into ** on apache:master**. |
I also converted DatastoreV1 to use this overload, and, as an exercise, added a withQuery(ValueProvider) overload to JdbcIO.
In that case it expands to TextIO.readAll().
retest this please |
1 similar comment
retest this please |
Alternatively R: @lukecwik |
Reincarnation of #3598 which got closed by accident
In that case it expands to TextIO.readAll(). Implementing this when the filepattern is a ValueProvider nudged me to also implement BEAM-2640 - Create.ofProvider(ValueProvider).
Links:
https://issues.apache.org/jira/browse/BEAM-2640
https://issues.apache.org/jira/browse/BEAM-2641
R: @reuvenlax CC: @sammcveety