-
Notifications
You must be signed in to change notification settings - Fork 38
Open
Description
It is now possible to run AI models directly through the docker model runner. GPU support etc comes natively. We should extend the GMT to allow energy benchmarking of these runs.
https://docs.docker.com/ai/model-runner/api-reference/
We should also check if it is possible to somehow get single prompts measured. This should also become a blog post.
Metadata
Metadata
Assignees
Labels
No labels