diff --git a/docs/source/configuration.rst b/docs/source/configuration.rst index 4ed8342b..e383812b 100644 --- a/docs/source/configuration.rst +++ b/docs/source/configuration.rst @@ -264,3 +264,15 @@ Now that spark is installed, restart the runtime. .config("spark.sql.session.timeZone", "GMT") .getOrCreate() ) + + +Troubleshooting Spark +~~~~~~~~~~~~~~~~~~~~~ + +The following section documents error that you may run into using spark, and how they can be resolved. + + TypeError: 'JavaPackage' object is not callable + +This error occurs when pyspark cannot find the required jars. Ensure that the location of "spark.jars" or "spark.jars.packages" is correct (see examples above). Stop the spark session and restart it with the exact location. You can use the ones hosted on github using the "spark.jars.pacakges" example or place the jars locally and use "spark.jars", depending on whichever is easiest in your setup. + +If you are running in a jupyter notebook, then the kernel needs to be restarted.