Skip to content

Read/write data from/to teradata and read from druid in Spark

Notifications You must be signed in to change notification settings

apoorv22/Spark-Druid-Teradata

Repository files navigation

Spark-Druid-Teradata

Teradata Setup

  • Download VMware WorkStation from here

  • Download Teradata express VMware image from here

  • Follow the steps from here to install and run teradata

  • Jars for jdbc drivers are available in lib folder

  • Make sure to put this line in build.sbt

    exportJars := true
  • Make note of th IP of virtual machine and use the jdbc url as jdbc:teradata://<IP>/<dbname>

Druid Setup

  • Follow this tutorial for druid setup on your machine

  • Add this line to druid-0.12.3/conf-quickstart/druid/broker/runtime.properties file

    druid.sql.enable = true
  • Add this dependency to build.sbt

    "org.apache.calcite.avatica" % "avatica-server" % 1.12.0
                                                excludeAll ExclusionRule(organization = "com.fasterxml.jackson.core")
    "org.apache.calcite.avatica" % "avatica-core" % 1.12.0
                                                        excludeAll ExclusionRule(organization = "com.fasterxml.jackson.core")

About

Read/write data from/to teradata and read from druid in Spark

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages