Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration. This demo repo has now been moved to the HuggingFace research projects repo here.
Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.
License
HuthLab/IGF
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
About
Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published