language model implemetation for js yarn install node build_tokens.js node train.js
allows running models with length>4096 on 8gb video cards, it's just an example of operation. to activate the video card, just remove the comments in the header of train.js