John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations for text classification and new robustness tests.
📢 Overview
LangTest 1.1.0 🚀 comes with brand new features, including: new capabilities to run different types of toxicity tests (lgbtqphobia, ideology, racism, xenophobia, sexism), support for doing templatic augmentations, extending support for HF datasets for summarization, support for BBQ-data, custom-replacement dicts for representation tests, CSV augmentations for text classification, using poetry as a dependency manager and adding new robustness tests (adjective-swapping and strip-all-punctuation) with many other enhancements and bug fixes!
A big thank you to our early-stage community for their contributions, feedback, questions, and feature requests 🎉
Make sure to give the project a star right here ⭐
🔥 New Features & Enhancements
- Adding support for improved toxicity tests #628
- Adding support for templatic augmentations #629
- Adding support for strip_all_punctuation test #618
- Adding support for adjective-swap tests #611
- Adding support for custom replacement dictionaries for representation and bias tests #600
- Adding support for BBQ-data #609
- Adding support for CSV augmentations in text classification task #617
- Adding support for hf datasets for summarization #589
- Adding poetry as a dependency manager #588
- Adding support for listing all available tests #592
- Adding support for enabling user to only install the backend libraries needed #597
🐛 Bug Fixes
- Model hub handler #601
- Fixing augmentations for swap-entities #622
- add_contraction bug for QA/Sum #615
❓ How to Use
Get started now! 👇
pip install langtest[transformers]
Create your test harness in 3 lines of code 🧪
# Import and create a Harness object
from langtest import Harness
h = Harness(task='ner', model='dslim/bert-base-NER', hub='huggingface')
# Generate test cases, run them and view a report
h.generate().run().report()
📖 Documentation
❤️ Community support
- Slack For live discussion with the LangTest community, join the
#langtestchannel - GitHub For bug reports, feature requests, and contributions
- Discussions To engage with other community members, share ideas, and show off how you use NLP Test!
We would love to have you join the mission 👉 open an issue, a PR, or give us some feedback on features you'd like to see! 🙌
♻️ Changelog
What's Changed
- feature: add poetry by @JulesBelveze in #588
- Add support for hf datasets summarization by @Prikshit7766 in #589
- Feature/poetry tasks by @JulesBelveze in #591
- feature: installation modes by @JulesBelveze in #597
- feature/Listing available tests by @RakshitKhajuria in #592
- Save augmentations by @RakshitKhajuria in #593
- fix: model hub handler by @JulesBelveze in #601
- chore: docstring check by @JulesBelveze in #599
- Custom replacement dictionaries for representation and bias tests by @Prikshit7766 in #600
- chore/remove logs by @JulesBelveze in #610
- fix(dependency): missing huggingface-hub dependency by @JulesBelveze in #613
- Fix/add_contraction bug for QA/Sum by @RakshitKhajuria in #615
- Dataset/BBQ data by @RakshitKhajuria in #609
- feature/ Robustness Tests -> Adjective synonym/antonym Swap by @RakshitKhajuria in #611
- Fix/hf datasets summarization default prompt by @Prikshit7766 in #623
- Feature/add strip all punctutation perturbation by @ArshaanNazir in #618
- Feature/Added support for CSV augmentations in text classification task by @Prikshit7766 in #617
- chore/nbs-website-update by @RakshitKhajuria in #619
- Fix/augmentations swap entities by @ArshaanNazir in #622
- Feature/toxicity types by @alytarik in #628
- fix/add bbq into package data by @alytarik in #633
- Docs/new toxicity nb and website by @alytarik in #630
- Hot-Fixes by @RakshitKhajuria in #631
- Hot fix/strip all punctuation by @ArshaanNazir in #632
- Blogpost notebook by @Prikshit7766 in #634
- Feature/add support for templatic augmentation by @chakravarthik27 in #629
- qa minor-fix by @Prikshit7766 in #637
- fix(dependency): monkey patch import in toxicity by @JulesBelveze in #640
- fixing some dependencies by @ArshaanNazir in #642
- Release/1.1.0 by @ArshaanNazir in #645
Full Changelog: 1.0.0...1.1.0
