Open
Description
In the Inference Optimisation chapter, there is no image suitable for Apple Silicon for ghcr.io/huggingface/text-generation-inference:latest and the AMD version does not work since it searches for NVIDEA GPU.
Recommendation: Maybe adding a small box that warns the users that TGI will not work locally on Apple Silicon Macs
Metadata
Metadata
Assignees
Labels
No labels