John Snow Labs LangTest 1.2.0: Enhancing Support for HF Dataset Augmentations, Advanced HF NER Support, Seamless End-to-End NER-HF Pipelines, Support for MLflow Metric Tracking and Performance Benchmarking with Speed Tests.
📢 Overview
LangTest 1.2.0 🚀 is here with a host of exciting improvements: It adds support for HF dataset augmentations, introduces NER support for HF, and presents end-to-end NER-HF pipelines for seamless operations. The update extends support for MLflow metric tracking and introduces a speed test in the new category of performance tests. Additionally, this version comes with other enhancements, documentation improvements, and bug fixes!
A big thank you to our early-stage community for their contributions, feedback, questions, and feature requests 🎉
Make sure to give the project a star right here ⭐
🔥 New Features & Enhancements
- Adding support for end-to-end NER pipeline #664
- Adding support for MLFlow metric tracking #683
- Adding support for HF dataset augmentations #653
- Adding support for NER for HF datasets #673
- Adding support for Speed Test #605
- Improved Documentation of available datasets #663
- Adding support for tests for datasets #649
❓ How to Use
Get started now! 👇
pip install langtest[transformers]
Create your test harness in 3 lines of code 🧪
# Import and create a Harness object
from langtest import Harness
h = Harness(task='ner', model='dslim/bert-base-NER', hub='huggingface')
# Generate test cases, run them and view a report
h.generate().run().report()
📖 Documentation
❤️ Community support
- Slack For live discussion with the LangTest community, join the
#langtestchannel - GitHub For bug reports, feature requests, and contributions
- Discussions To engage with other community members, share ideas, and show off how you use LangTest!
We would love to have you join the mission 👉 open an issue, a PR, or give us some feedback on features you'd like to see! 🙌
♻️ Changelog
What's Changed
- website update for Blog by @Prikshit7766 in #587
- Docs/website-nbs-updates by @RakshitKhajuria in #644
- PR for website and NB updates by @ArshaanNazir in #647
- templatic augmetation nb by @chakravarthik27 in #638
- chore: load data in raw format by @JulesBelveze in #649
- update: harness configure by @chakravarthik27 in #656
- fix: NER export by @JulesBelveze in #657
- Revert "fix: NER export" by @JulesBelveze in #658
- Fix/ner csv export by @JulesBelveze in #659
- feature/add random age test by @alytarik in #654
- feature(CI): release workflow by @JulesBelveze in #672
- Docs/add documentation for the available datasets by @Prikshit7766 in #663
- Update PULL_REQUEST_TEMPLATE.md by @JulesBelveze in #675
- Update pr template by @RakshitKhajuria in #677
- hot-fix(datasource.py) by @RakshitKhajuria in #676
- updated blog notebook by @Prikshit7766 in #679
- Refactor/change runtime speed into a test by @chakravarthik27 in #605
- add random age test to website by @alytarik in #678
- Pytest for fairness class by @RakshitKhajuria in #682
- fix/sentences containing white spaces for ConllDataset by @Prikshit7766 in #681
- Webiste Updates by @ArshaanNazir in #684
- NER support for HF datasets by @alytarik in #673
- feature: end-to-end NER pipeline by @JulesBelveze in #664
- add ner task to hf datasets by @alytarik in #690
- Feature/ml flow integration by @ArshaanNazir in #683
- Feature/hf dataset augmentation by @RakshitKhajuria in #653
- fix(dependencies): missing dependencies by @JulesBelveze in #693
- Docs/website updates by @ArshaanNazir in #692
- update: colab link in performancetest notebook by @chakravarthik27 in #691
- Docs/website updates by @ArshaanNazir in #694
- fix/merge conflicts release 1.2.0 by @JulesBelveze in #697
- Release/1.2.0 by @JulesBelveze in #698
Full Changelog: 1.1.0...1.2.0
