Max Tokens config does not appear for gemini-2.5-pro; it should

[nissa-seru]

App Version

v3.14.3

API Provider

GCP Vertex AI

Model Used

gemini-2.5-pro-exp-03-25 AND gemini-2.5-pro-preview-03-25

Actual vs. Expected Behavior

Actual: Max Tokens slider does not appear for this model

Expected: Display Max Tokens slider for this model, defaulting to 65535 (the maximum value.)

Detailed Steps to Reproduce

N/A

Relevant API Request Output

N/A

Additional Context

N/A

[cannuri]

This seems to be related to #3010

I am having a look at it.

[egable]

@hannesrudolph Please make sure we can also set max input tokens allowed for the model. 1M tokens gets really expensive really quick. I'd rather cap the tokens at 200k and have it remove context history to stay under that.

[hannesrudolph]

@hannesrudolph Please make sure we can also set max input tokens allowed for the model. 1M tokens gets really expensive really quick. I'd rather cap the tokens at 200k and have it remove context history to stay under that.

Can you please make an issue:feature request for this?