DJL v0.23.0 release

Key Features

• Upgrades for engines

  • Upgrades PyTorch engine to 2.0.1
  • Upgrades javacpp version to 1.5.9 (#2636)
  • Upgrades HuggingFace tokenizer to 0.13.3 (#2697)
  • Upgrades OnnxRuntime version to 1.15.0 and other dependencies version (#2658)

• Enhancements for engines and API

  • Adds XGBoost aarch64 support (#2659)
  • Adds fastText macOS M1 supports (#2639)
  • Creates asynchronous predictStreaming (#2615)

• Introduces text-generation search algorithm

  • Implements text-generation search algorithm (#2637)
  • Enhancement features for LMSearch (#2642)

Enhancement

• DJL API improvements:

  • Adds uint16, uint32, uint64, int16, bf16 data type (#2570)
  • Adds NDArray topK operator for PyTorch (#2634)
  • Adds support for unsigned datatype (#2574)
  • Allows subclass access member variable of Predictor (#2582)
  • Makes PredictorContext constructor public (#2586)
  • Refactor ChunkedBytesSupplier to avoid unnecessary conversion (#2587)
  • Move compileJava() into ClassLoaderUtils (#2600)
  • Enable boolean input on ort (#2644)
  • Adds more logs for platform detection (#2646)
  • Improves DJL URL error message (#2678)
  • Avoid exception if SecurityManager is applied (#2665)
  • Masks sensitive env vars in debug print out (#2657)
  • open isImage() method to package children for reuse-enabling custom datasets (#2662)
  • Migrate google analytics (#2654)

• PyTorch engine improvements

  • Load dependencies with specific order (#2599)
  • Improves IValue tuple of tuple support (#2651)
  • Add basic median support (#2701)

• Spark extension enhancements

  • Support requirements.txt in model tar file (#2528)
  • Upgrade dependency version in Dockerfile (#2569)
  • Use batch predict in spark (#2545)
  • Change implicit conversions to explicit (#2595)

• Huggingface tokenizer enhancements

  • Allow creating BPE huggingface tokenizers (2550)

• Tensorflow engine enhancements

  • Reload javacpp properties (2668)

Breaking change

Bug fixes

• Avoids exception for cuda version lower than 10.x (#2583)
• Reverts "[bom] Simplify BOM build script (#2438)" 2598
• CI fails looking for v3 reverting to v2 (#2604)
• Fixes the dependencies issue (#2609)
• Fixes the usage of the repeat function for embedding (#2590)
• Adds missing djl-zero to bom (#2625)
• Fixes tabnet predictor (#2643)
• Fixes error message in X.dot(w) (#2688)
• Fixes liquid parsing issues in pytorch ndarray cheatsheet (#2690)
• Fixes getIOU bug (#2674)
• Fixes setup formatting (#2653)
• Fixes broken link (#2622)
• Fixes LocalRepository detection (#2593)
• Fix jupyter notebook links (#2704)

Documentation and Examples

• Adds docs on JNI compilation (#2510)
• Updates import tensorflow model README (#2614)
• Updates pytorch native JNI development document (#2613)
• Setup - Running on M1 Macs (#2652)
• Adds pytorch vs djl ndarray cheatsheet (#2661)
• Updates timeseries README (#2667)
• Adds PT NDArray cheat sheet to docs (#2670)
• Cleans stable_diffusion and add missing .md language blocks (#2635)
• Updates README (#2596)
• Fixes typos (#2603)
• Fixes markdown format (#2608)

CI improvements

• Upgrades github action gradle plugin to v3 (#2576)
• Avoids upload djl-serving.tar to S3 if already exist (#2578)
• Upgrades spotbugs to 5.0.14 (#2594)
• Upgrades gradle to 8.1.1 (#2611)
• Publishes PyTorch 2.0.1 jni package (#2699)
• Removes cu102 test (#2689)
• Fixes nightly publish ci bug (#2691)
• Fixes djl-serving release publish workflow script (#2568)
• Minor fix to the instance spinning (#2606)
• Adds Triton and FasterTransformers source build instruction (#2605)
• Publishes triton executable (#2617)
• Adds http endpoint in the build (#2618)

Contributors

Thank you to the following community members for contributing to this release:
@frankfliu
@KexinFeng
@lanking520
@xyang16
@zachgk
@takanori-ugai
@tosterberg
@siddvenk

New Contributors

• @larochef made their first contribution in #2550
• @Crusader99 made their first contribution in #2603
• @juliangamble made their first contribution in #2652
• @i10416 made their first contribution in #2661

Full Changelog: v0.22.1...v0.23.0