Fix/sequence length power of 2#158

Merged

le1nux merged 21 commits intodev_experimentsfrom

fix/sequence_length_power_of_2

Jun 30, 2024

Commits on Jun 19, 2024

refactor: block_size in datasets is now sequence_length +1
le1nux
committed
fix: failing end2end tests due to sequence_length / block_size changes
le1nux
committed
refactor: replaced context_size and block_size with sequence_length when applicable
le1nux
committed

Commits on Jun 20, 2024

refactor: the last token from a block (i.e., last target token) is used as the first token (i.e., first input token) of the subsequent block
le1nux
committed
refactor: renamed all model_sequence_length with sequence_length
le1nux
committed

Commits on Jun 25, 2024

Commits on Jun 29, 2024

chore: add comments
mali-git
committed

Commits on Jun 30, 2024