Add a short JDBC user guide #2148
Conversation
HyukjinKwon
commented
Apr 12, 2021
HyukjinKwon
commented
| "spark.jars", | ||
| "{}/sqlite-jdbc-3.34.0.jar".format(os.getcwd())) | ||
| .config( | ||
| "spark.driver.extraClassPath", |
There was a problem hiding this comment.
Do we need to set spark.executor.extraClassPath as well?
There was a problem hiding this comment.
Maybe not:
Extra classpath entries to prepend to the classpath of executors. This exists primarily for backwards-compatibility with older versions of Spark. Users typically should not need to set this option.
https://spark.apache.org/docs/latest/configuration.html#runtime-environment
There was a problem hiding this comment.
But it might still be needed if the older versions of Spark includes 2.4?
There was a problem hiding this comment.
I think it's okay to just leave it ... I referred to https://spark.apache.org/docs/3.1.1/sql-data-sources-jdbc.html#content.
Codecov Report
@@ Coverage Diff @@
## master #2148 +/- ##
=======================================
Coverage 95.36% 95.36%
=======================================
Files 60 60
Lines 13707 13707
=======================================
Hits 13071 13071
Misses 636 636 Continue to review full report at Codecov.
|
|
LGTM, thanks! |
|
Thanks! merging. |
