Feature Request: Auto-fetch model specs from models.dev

[delafthi]

I'd love to suggest integrating with models.dev (or a similar model database) to automatically fetch model-specific metadata (max tokens, context length, pricing, etc.) instead of having users manually configure each model.

Why this would be helpful

First off, mods is fantastic – I use it all the time! But there's one small friction point I keep running into. Right now, to get optimal performance from different models, I need to set max-input-chars and max-tokens for each one individually. The alternative is setting a global value somewhere in the middle, but then each model isn't really optimized.

Here's the tradeoff I'm facing:

• Global settings: Easy to configure, but models don't perform optimally since they all have different capabilities
• Per-model settings: Optimal performance, but requires researching and manually configuring each model
• Things get outdated: Model specs change over time, and my configs don't automatically update
• Inconsistent setups: Different users probably have different configurations for the same models
• Barrier to trying new models: The setup friction makes me less likely to experiment with newer models

What I'm thinking

What if mods could automatically grab all that metadata from models.dev? Things like:

• Maximum input tokens/characters
• Context window size
• Token limits
• Pricing information
• Model capabilities and features
• Provider-specific parameters

This way, I could just specify the provider and model name, and mods would automatically use the optimal settings for each model!

Benefits this would bring

1. Best of both worlds: Simple configuration AND optimal per-model settings
2. Always up-to-date: Model specs would stay current automatically
3. Lower barrier to experimentation: Much easier to try new models
4. Consistent experience: Everyone gets the same, optimal configurations

Thoughts?

I think this could make an already great tool even better, and I'd be happy to contribute to making this happen. What do you think about this approach? Any particular implementation preferences, or concerns I should consider?

Looking forward to hearing your thoughts!

[delafthi]

I just saw that you have https://github.com/charmbracelet/catwalk now. An integration with that would be great.