ScalaDL Ideomatic Scala Wrapper Around Deep Learning Framework JDL
Deep learning is dominated by excellent Python frameworks. There is a new framework JDL that is a Java wrapper around several of those: PyTorch and TensorFlow.
JDL has a strong Java flavor. There is an opportunity for to make a thin Scala wrapper around this.
Maybe this could be useful for Scala Spark.
Status Starter Project
Ported class, ObjectDetection.java, from DJL to ObjectDetection.Scala and to BaseObjectDetection.scala.
- ObjectDetection.Scala is a direct port
- BaseObjectDetection.scala is a port that is wrapped in a class
How to Run
git clone https://github.com/sami-badawi/scaladl.git
# Run with default image
sbt run
# Run user supplied image
sbt "run ~/Pictures/laptop_baby.jpg"
# Run with default image and engine with engine index 1
sbt "run src/test/resources/dog_bike_car.jpg 1"
sbt "run src/test/resources/dog_bike_car.jpg 1"
# Run with default image and engine with engine index 1
sbt "runMain org.scaladl.ObjectDetection src/test/resources/dog_bike_car.jpg 1"
# Run with default image and MXNet engine using BaseObjectDetection.scala
sbt "runMain org.scaladl.object_detection.BaseObjectDetection src/test/resources/dog_bike_car.jpg MXNet"Output
Available engines:
PyTorch
MXNet
TensorFlow
prediction: [
class: "laptop", probability: 0.96828, bounds: [x=0.145, y=0.088, width=0.830, height=0.915]
class: "person", probability: 0.92875, bounds: [x=-0.013, y=0.021, width=0.458, height=0.978]
]
Detected image from ~/Pictures/laptop_baby.jpg saved to: build/output
Issues
MXNet and PyTorch is working well, but Tensorflow throws an exception.
Libraries Etc.
Using Scala 3 / Dotty. Just for fun. Will add cross compile to Scala 2.x if useful.
Thoughts on Abstractions
Might try to use Cats, Free Monad, Tagless Final or some of that fancy heavy artillery that you should not use in prod. If they are not useful, they will be ripped out again.
Collaborators
If ScalaDL goes anywhere collaborate would be welcome. The goal is to make a thin wrapper.