Skip to content
This repository was archived by the owner on Feb 3, 2021. It is now read-only.

0.6.0

Choose a tag to compare

View all tags
@jafreck jafreck released this 23 Feb 23:13
· 127 commits to master since this release
v0.6.0
b833561
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

0.6.0 Mixed Mode, Cluster Run & Copy

Features:

  • aztk spark init customization flags
  • aztk spark cluster run command added
  • aztk spark cluster copy command added
  • enable Spark dynamic allocation by default
  • add SDK support for file-like objects
  • add Spark integration tests
  • add flag worker_on_master option for cluster and job submission mode
  • Spark driver runs on master node for single application job submission mode

Bug Fixes:

  • load jars in .aztk/jars/ in job submission mode
  • replace outdated error in cluster_create
  • fix type error crash if not jars are specificed in job submission
  • stop using mutable default parameters
  • print job application code if exit_code is 0
  • job submission crash if executor or driver cores specified
  • wrong error thrown if user added before master node picked
Assets 2
Loading