-
Notifications
You must be signed in to change notification settings - Fork 205
Closed
Labels
Description
- [Docs] Reworked
README.mdto move the focus from Alignment Handbook to how it can be used withdstack - [Hotfix] Removed
tensorboardfromconfig.yaml(due to the non-fixed issue with Alignment Handbook) throwing an exception - [Bugfix] Replaced
use_flash_attention_2: truewithattn_implementation: flash_attention_2 - [Bugfix] Added
bnb_4bit_quant_storage: bfloat16(otherwise Alignment Handbook threw an exception) - [UX] Added fleet configurations for both single-node and multi-node tasks
- [UX] Remove the logic of coping config files (e.g.
ACCEL_CONFIG_PATH) - [UX] Remove the unnecessary environment variables (
FT_MODEL_CONFIG_PATHandACCEL_CONFIG_PATH) - [UX] Pin the version of Python to
3.10 - [UX] Moved
ACCELERATE_LOG_LEVELtoenv - [UX] Changed
24GB:2to24GBfor simplicity - [UX] Changed
nodes: 3tonodes: 2for simplicity - [UX] Added comments to task configurations