Running the ThriftServer with Sparklinedata components

1. Download the latest sparklinedata jar from Releases

2. Copy the scripts from our Repo to your spark sbin directory

3. to start the thriftserver issue:

sbin/start-sparklinedatathriftserver.sh <location of the downloaded jar>

for example:

sbin/start-sparklinedatathriftserver.sh ~/Downloads/spark-druid-olap-0.0.3.jar

for yarn run

./start-sparklinedatathriftserver.sh ~/Downloads/spark-druid-olap-assembly-0.0.3.jar --master yarn

In the following we run thriftserver on yarn and with timezone set to UTC, point to custom spark.properties, and configure the FAIR scheduler

JAVA_TOOL_OPTIONS=-Duser.timezone=UTC sbin/start-sparklinedatathriftserver.sh accelerator_2.10-0.2.1-assembly.jar \
--driver-memory 19g --master yarn --deploy-mode client --conf spark.scheduler.mode=FAIR --properties-file sparkline.properties"

4. To stop the thriftserver issue:

sbin/stop-sparklinedatathriftserver.sh