Apache Spark DataSources

TensorFlow

Dependencies

• Apache Spark 2.4.5 -> https://github.com/apache/spark/releases/tag/v2.4.5
• TensorFlow 1.5.0 -> https://github.com/tensorflow/tensorflow/releases/tag/v1.5.0

Branch

https://github.com/mvrpl/Spark_DataSources/tree/TensorFlow

Blog Post

https://mvrpl.dev.br/post/spark_scala-detec%C3%A7%C3%A3o-de-objetos-em-imagens-com-tensorflow

Credits

https://github.com/chen0040/java-ssd-object-detection

HTML

Dependencies

• Apache Spark 2.4.4 -> https://github.com/apache/spark/releases/tag/v2.4.4
• Jsoup 1.8.3 -> https://github.com/jhy/jsoup/releases/tag/jsoup-1.8.3

Branch

https://github.com/mvrpl/Spark_DataSources/tree/HTML

Blog Post

https://mvrpl.dev.br/post/spark_scala-criando-nova-fonte-de-dados