Supporting AutoModelForCausalLM

[jis478]

Hi, I'm writing a new class like this for models in the AutoModelForCausalLM format. Originally I've been testing sql-coder model with this but thought this could be generalized as a class. Do you have an on-going PR or can i make one?

[zainhoda]

This isn't something that I've heard from other users so please feel free to make a PR!

[jis478]

Thanks, I've made PR (#391)

[jis478]

By the way the original Sql-coder repo is also implemented using the Huggingface Transformers library with its own prompt template. As pointed out in #303 (comment), it would be great if you tested it out again with the original repo (I'm currently working on getting it to run on Vanna, based on this PR as well)

[andreped]

By the way the original Sql-coder repo is also implemented using the Hugging Face Transformers library with its own prompt template. As pointed out in #303 (comment), it would be great if you tested it out again (I'm currently working on getting it to run on Vanna, based on this PR as well)

Would be of interest to me as well, @zainhoda. Great suggestion, @jis478! :]