v3.2.0

Docker Image:

quay.io/modh/fms-hf-tuning:v3.2.0

What's Changed

• fix: add setup scm version config to pyproject for correct version tag while building wheel. by @dushyantbehl in #634
• fix: pypi classifier tag by @YashasviChaurasia in #636
• chore: update peft version to v0.18.0 by @YashasviChaurasia in #638
• fix: typo in log message about validation dataaset by @HarikrishnanBalagopal in #640
• feat: Adds embed_tokens, lm_head as trainable for vocab expansion in peft and enables tying of adapters by @romitjain in #625
• fix: add global step number in hf moe chpt by @YashasviChaurasia in #643
• fix: ODM dispatch by @romitjain in #647
• fix: nvcr dockerfile build faliing due to flash attn. by @dushyantbehl in #646
• feat: ODM without categories integration with fms-accel by @romitjain in #641
• fix: Updated ODM defaults by @romitjain in #648
• fix: Enabled GPU based tests by @romitjain in #649
• chore: fix image build and push actions to automate image build process. by @dushyantbehl in #650
• feat: Added dataset split support by @romitjain in #651
• fix: bump up pillow version, fix for cve by @YashasviChaurasia in #657
• chore: tcr dependency and fix odm link by @YashasviChaurasia in #654
• feat: add dcp to hf checkpoint offline util by @YashasviChaurasia in #655
• fix: add fms-recommender wrapper by @YashasviChaurasia in #644
• fix: fix recommender install by @YashasviChaurasia in #660
• feat: Add documentation on data config selection by @Akash-Nayak in #567
• fix: fix fms-adapter wrapper by @YashasviChaurasia in #661
• fix: Update image.yaml to use vars for repository by @dushyantbehl in #662
• Fix docker image tag formatting in workflow by @dushyantbehl in #663
• fix: inject processor into data handler fn_kwargs by @YashasviChaurasia in #664
• feat: Add app folder in nvcr image to mimic dockerfile by @dushyantbehl in #665
• fix: update dockerfile by @dushyantbehl in #667
• fix: add github workflow by @dushyantbehl in #668
• fix: Update nvcr by @dushyantbehl in #669
• ci: fix issues with the container image by adding some sanity checks before pushing by @HarikrishnanBalagopal in #670
• feat: upgrade to transformers v5 by @yash4242 in #659
• fix: fix few errors in main by @dushyantbehl in #673
• chore: Revert "feat: upgrade to transformers v5" by @dushyantbehl in #674
• fix: revert nvcr.Dockerfile by @YashasviChaurasia in #675
• fix: vision image token insertion by @YashasviChaurasia in #671
• fix: remove unsafe pickle deserialization in txt_to_obj (CVE CWE-502) by @YashasviChaurasia in #677
• fix: prevent expression injection in pr-command workflow (CWE-78) by @YashasviChaurasia in #678
• bump pillow version by @dushyantbehl in #679
• fix: use pyproject-build in tox build env to avoid local build/ shadowing by @dushyantbehl in #680
• fix: stop shipping build/ in the wheel and use SPDX license expression by @dushyantbehl in #681
• chore: update CODEOWNERS to current reviewers by @dushyantbehl in #682

New Contributors

• @yash4242 made their first contribution in #659

Full Changelog: v3.1.0...v3.2.0