New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add a convention for loading yaml config files from the classpath #6
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add at 2 tests for reading config off of classpath (success and failure), and update README to document new behavior.
@dougb ^ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
I don't have merge perms on this repo (yet). Can you add me or merge it, @dougb or @phpisciuneri? |
@colindean we were trying to get the CI sorted out. Sorry for the delay. @dougb @c-horn merging branch master into this PR didn't seem to trigger any action. The status check is still waiting for |
Instead of explicitly including the config file with
spark-submit
like:If the yaml file is already on Spark's driver classpath (for instance in a jar compiled from a
resources/
directory included in a package added with--packages
or--jars
), you can reference it: