How to continue pretrain LLM fp8 with hf_causal_lm

[YixinSong-e]

When I continue pretrain HF models with fp8, there is an error:
TypeError: ComposerHFCausalLM.init() got an unexpected keyword argument 'fc_type'

[dakinggg]

This needs significantly more information to help you. Please provide what you are trying to run, what you modified in the yaml from the examples, and what the output of that is.

That being said, we only have support for fp8 when using ComposerMPTCausalLM at this time.