Skip to content

MrPowers/mill_spark_example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Mill Spark Example

An example Apache Spark project built with Mill.

Build

Build fat JAR file:

mill foo.assemble

Test

mill foo.test

TODO

  • Turn off logging
  • Fix "Exception in thread "Thread-1" java.lang.NoClassDefFoundError: org/apache/hadoop/util/ShutdownHookManager$2" message when the test suite finishes running
  • Figure out how to do a sbt clean like command
  • Customize the JAR file name that's generated
  • Shading dependencies

About

Apache Spark project with the Mill build tool

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages