Public GPU Implementation

[mitchelldehaven]

Currently the GPU implementation for the MediaPipe LLM inference isn't included in this repository. This was first discussed here: #5305 and a few other issues have touched on it.

Are there current plans to open include the GPU implementation in this repository? These issues were raised over a year ago and I was hoping the implementation would be included in this repository by now.

[kuaashish]

Hi @schmidt-sebastian,

Do you have any information on GPU support for MediaPipe LLM inference using the C API? We previously reported an issue here: #5305 and have closed it from our side. Could you please share any additional pointers or updates you may have.

Thank you!!

[whhone]

Closing this for now, but please follow our blog announcements when we announce public support. Thank you!

[google-ml-butler]

Are you satisfied with the resolution of your issue?
Yes
No