Skip to content

Conversation

@fhueske
Copy link
Contributor

@fhueske fhueske commented Jan 23, 2018

What is the purpose of the change

  • enable recursive directory enumeration for OrcTableSource (Hive's default behavior)
  • expose the configuration in the OrcTableSource builder.

Brief change log

  • see purpose above

Verifying this change

  • Unit test to validate configuration of FileInputFormat has been added in OrcTableSourceTest.testBuilder()

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? Java docs of builder + web documentation.

@fhueske
Copy link
Contributor Author

fhueske commented Feb 5, 2018

Merging

fhueske added a commit to fhueske/flink that referenced this pull request Feb 5, 2018
fhueske added a commit to fhueske/flink that referenced this pull request Feb 5, 2018
fhueske added a commit to fhueske/flink that referenced this pull request Feb 5, 2018
@asfgit asfgit closed this in de3d85b Feb 5, 2018
JTaky pushed a commit to criteo-forks/flink that referenced this pull request Feb 16, 2018
glaksh100 pushed a commit to lyft/flink that referenced this pull request Jun 6, 2018
@fhueske fhueske deleted the orcRecursive branch February 25, 2019 22:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants