CodeT5+ as the next model for FauxPilot?

[chat-guy]

The Salesforce research team just revealed CodeT5+, with SoTA performance: https://github.com/salesforce/CodeT5/tree/main/CodeT5+

The corresponding research paper: https://arxiv.org/pdf/2305.07922.pdf

[moyix]

Maybe – there are now several new models that look very promising as successors to CodeGen – CodeGen2, CodeT5+, and StarCoder, and Replit's model. Unfortunately none of these (except maybe CodeT5+?) are supported in FasterTransformer, so they would have to be added through the Python backend, and we'd want to evaluate how the latency is.

[pai4451]

@moyix Is it possible to convert CodeGen2 to GPT-J and use FasterTransformer backend similar to CodeGen1?