Difference between bar_fsq_16bits_ft and bar_fsq_16bits

[Tianhang-Cheng]

Hi, thanks for the great work! I was wondering what is the difference of bar_fsq_16bits_ft and bar_fsq_16bits? seems they use the same bits and same structure.

experiment.tokenizer_checkpoint=assets/tokenizer/bar_fsq_16bits_ft.bin
experiment.tokenizer_checkpoint=assets/tokenizer/bar_fsq_16bits.bin

[yucornetto]

The ft ckpt has its decoder finetuned for 40 more epochs (encoder / quantizer remains frozen and same as base one), which leads to a better performance. It is also noted in 4.1 Implementation Details -- Tokenizer part.