Repository navigation
v2.26.0: resolve trainer attention in one helper
Features
-
resolve trainer attention in one helper
resolve_attn_implementationnow picks the trainer attention backend in one place. Order: an explicit value, thenATTN_IMPLEMENTATION/AGILERL_ATTN_IMPLEMENTATION, then the family trainer default (Gemma sliding-windowflex_attention, Nemotron-Hflash_attention_2), thenflash_attention_2ifflash_attnis installed otherwisesdpa.LLMBuilderandcreate_model_from_name_or_pathboth go through that helper. Nemotron-H's catalog trainer config setsattn_implementationtoflash_attention_2.
Full Changelog: v2.25.0...v2.26.0