Unable to remove a specific model from the cache using the alias

[Vikas Sharma (vksx)]

As per the Model cache key commands docs, the command foundry cache remove <model-name> removes a specific model from the cache.

So, ideally, it should remove a model using the model name/alias. But currently it shows the message Model <model-alias> not found in cache as follows:

It only works with the Model ID.

[Samuel Kemp (samuel100)]

Vikas Sharma (@vksx) Thanks for raising an issue. Currently, we only allow Model_Id for cache rm and model unload commands.

https://learn.microsoft.com/en-gb/azure/ai-foundry/foundry-local/reference/reference-cli#cache-commands

Here is the rationale:

We can enable using model alias for cache rm and model unload - we are waiting for some feedback on what you'd expect the system to do:

1. Unload/Remove the best variant
2. Unload/Remove all variants for the alias
3. Or hybrid -- unload/remove the best variant and provide an option for all models under alias e.g. foundry cache remove qwen2.5-coder-0.5b --all

[Vikas Sharma (vksx)]

The rationale makes total sense.

I like the hybrid approach you mentioned:

• The default should unload/remove the best variant, paralleling the behaviour of foundry model run <model> (I was initially expecting this)
• having --all flag, as you mentioned, for a complete cleanup.

[Samuel Kemp (samuel100)]

Thanks Vikas Sharma (@vksx)! I'll turn this into a discussion for others to chime in on expected behaviour.

[Samuel Kemp (samuel100)]

Vikas Sharma (@vksx) This has been address in the latest release: https://github.com/microsoft/Foundry-Local/releases/tag/v0.4.91

[Vikas Sharma (vksx)]

Awesome, thanks!