Repository navigation
XTuner Release V0.1.14
What's Changed
- set dev version by @LZHgrla in #341
- [Feature] More flexible
TrainLoopby @LZHgrla in #348 - [Feature]Support CEPH by @pppppM in #266
- [Improve] Add
--repetition-penaltyforxtuner chatby @LZHgrla in #351 - [Feature] Support MMBench DDP Evaluate by @pppppM in #300
- [Fix]
KeyErrorofencode_fnby @LZHgrla in #361 - [Fix] Fix
batch_sizeof full fine-tuing LLaVA-InternLM2 by @LZHgrla in #360 - [Fix] Remove
systemforalpaca_map_fnby @LZHgrla in #363 - [Fix] Use
DEFAULT_IMAGE_TOKENinstead of'<image>'by @LZHgrla in #353 - [Feature] Support internlm sft by @HIT-cwh in #302
- [Fix] Add
attention_maskfordefault_collate_fnby @LZHgrla in #371 - [Fix] Update requirements by @LZHgrla in #369
- [Fix] Fix rotary_base, add
colors_map_fntoDATASET_FORMAT_MAPPINGand rename 'internlm_repo' to 'intern_repo' by @HIT-cwh in #372 - update by @HIT-cwh in #377
- Delete useless codes and refactor process_untokenized_datasets by @HIT-cwh in #379
- [Feature] support flash attn 2 in internlm1, internlm2 and llama by @HIT-cwh in #381
- [Fix] Fix installation docs of mmengine in
intern_repo_dataset.mdby @LZHgrla in #384 - [Fix] Update InternLM2
apply_rotary_pos_embby @LZHgrla in #383 - [Feature] support saving eval output before save checkpoint by @HIT-cwh in #385
- fix lr scheduler setting by @gzlong96 in #394
- [Fix] Remove pre-defined
systemofalpaca_zh_map_fnby @LZHgrla in #395 - [Feature] Support
Qwen1.5by @LZHgrla in #407 - [Fix] Fix no space in chat output using InternLM2. (#357) by @KooSung in #404
- [Fix] typo:
--system-promptto--system-templateby @LZHgrla in #406 - [Improve] Add
output_with_lossfor dataset process by @LZHgrla in #408 - [Fix] Fix dispatch to support transformers>=4.36 & Add USE_TRITON_KERNEL environment variable by @HIT-cwh in #411
- [Feature]Add InternLM2-Chat-1_8b full config by @KMnO4-zx in #396
- [Fix] Fix extract_json_objects by @fanqiNO1 in #419
- [Fix] Fix pth_to_hf error by @LZHgrla in #426
- [Feature] Support
Gemmaby @PommesPeter in #429 - add refcoco to llava by @LKJacky in #425
- [Fix] Inconsistent BatchSize of
LengthGroupedSamplerby @LZHgrla in #436 - bump version to v0.1.14 by @LZHgrla in #431
New Contributors
- @gzlong96 made their first contribution in #394
- @KooSung made their first contribution in #404
- @KMnO4-zx made their first contribution in #396
- @fanqiNO1 made their first contribution in #419
- @PommesPeter made their first contribution in #429
- @LKJacky made their first contribution in #425
Full Changelog: v0.1.13...v0.1.14