Skip to content

Real Offline Version (Dockerfile) + More resilience

Latest
Latest
Compare
Choose a tag to compare
@MathiasExorde MathiasExorde released this 01 Mar 10:12
v2.5.7
270b3e9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Release Notes - [Your Project Name] Version [X.Y.Z]

New Features and Improvements

  • Enhanced Offline Support: We've made significant strides in enhancing the offline capabilities of our workers. By setting TRANSFORMERS_OFFLINE=1, HF_DATASETS_OFFLINE=1, and HF_HUB_OFFLINE=1, we ensure that our dependencies on external services like Hugging Face are minimized. This update includes caching for fasttext-langdetect/lid.176.bin, Hugging Face-based models, and Argos Translate models, ensuring that our workers can operate completely offline without any hiccups.

  • Increased Resilience: Our workers are now more resilient than ever. They no longer depend heavily on third-party services, which means temporary outages or HTTP errors from platforms like GitHub will not disrupt our operations as before. This marks a significant step towards our goal of decentralization, reducing our dependency on external services and enhancing our system's robustness.

  • WtpSplit Version 1.3.0: The WtpSplit tool has been upgraded to version 1.3.0. This update brings improvements in language detection accuracy, making it easier and more reliable to determine the language from text. This enhancement is part of our continuous effort to improve the functionality and performance of our tools.

Thank you for your continued support and feedback, which help us make [Your Project Name] better with each release.

Assets 2