Skip to content

CTranslate2 2.2.0

Compare
Choose a tag to compare
@guillaumekln guillaumekln released this 06 Jul 15:06
· 845 commits to master since this release

New features

  • Add Python utility functions to query the system capabilities:
    • ctranslate2.get_cuda_device_count
    • ctranslate2.get_supported_compute_types
  • Add option fixed_dictionary in the Fairseq converter to support multilingual models
  • Extend environment variable CT2_VERBOSE to configure more log levels (see README)

Fixes and improvements

  • Fuse activation with bias addition on GPU for a small performance increase
  • Make the GELU activation compatible with FP16 execution
  • Improve the log format using the spdlog library
  • Improve the accuracy of the profiling results on GPU
  • Update Intel oneAPI to 2021.3