Using TGI with Intel Gaudi Check out this repository to serve models with TGI on Gaudi and Gaudi2 with Optimum Habana.