Support for gpt-neox model

[hyungwonchoi]

Thanks for your amazing work! Hope this can boost up the whole llm community.
Do you have any plans to support gpt-neox model (https://github.com/EleutherAI/gpt-neox) as another base model?

Thanks.

[casper-hansen]

I would love to support gpt-neox amongst other models. I am a bit GPU constrained, though, so it will be a while before I can get support out for models that require larger GPUs.