Skip to content
Discussion options

You must be logged in to vote

Ah ok, I think I get it now. All of my openrouter models I have setup in Windmill use the {provider}/{model}-latest pattern. Those all seem to be unknowable by Windmill all defaulting to 128k. When I set a model on an actual version, not using -latest, it seems Windmill can actually know the context window. I assumed it was something simple. Thank you. Im not sure id suggest this should or could become an issue, or if it is even possible for windmill to fetch the actual model being used under the hood in the latest flag. Perhaps a brief note somewhere in the AI section of the docs may help a small number of people like me, as im sure I wont be the last to wonder this. But regardless, thanks

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@adenoz
Comment options

Answer selected by adenoz
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants