Plans to allow model changes in AI Assistant in the Chat UI vs Preferences?

[edhans]

Like the subject says - with most of the chat UIs we can change the model right there from Sonnet to Opus to Fable or whatever.

In TE/3 though you have to go to preferences to change it, and you may not even realize what model you are using. The AI Assistant UI doesn't say, so you could be using too much model (cost) for a given set of tasks - say just renaming variables or doing some basic querying, too little model for a more complex task, etc.

Or in my current case, I cannot use the model I want because Sonnet 5 isn't listed, and I am on TE 3.26.3.

[mlonsk]

Hi @edhans
Good idea to ensure the model is at least shown and potentially selectable in the main AI Assistant menu. I passed this feedback on to the engineering team.

The Model Name field is a free-text field, and the dropdown is merely a suggestion. You can write any model name in; you are not limited to the models appearing in the dropdown. So just write claude-sonnet-5 to choose that model, and you should be all set.

[mlonsk]

Just a quick follow-up. The AI Assistant currently has a little gear in the top right corner, which brings you directly to the model configuration, saving you a few clicks to change the model.

[edhans]

Thanks.

FWIW, I cannot get Sonnet 5 to work. I tried your text and it just perpetually thinks. I tried claude-sonnet-5-0 and that returned an error, so your text is correct. I switched to claude-sonnet-4-6 and it ran fine. Not sure what is going on there.

Another issue - this is what I see when the Assistant recommends code changes. I don't think I have any special theme going - just using the blue background which is your theme. I have to highlight the recommended changes to see it.

[mlonsk]

In my testing using Claude Sonnet 5 works and I get replies in the AI Assistant as normal. This is my setup in the preferences:

And this is a test respone using those settings:

The model name used is the the Claude API ID or Alias as documented here by Anthropic: https://platform.claude.com/docs/en/about-claude/models/overview

For incorporating the model name into the AI Assistant pane, would this mockup of UI be what you where looking for, or do you think it should be placed somewhere else?

I have spun the second part around DAX rendering off into a separate issue: #1581
The best workaround for now is to use a Dark Mode theme as the boxes are readable there.

[edhans]

Thanks for the info. I tried Sonnet 5 again this morning and it worked, so could have been a glitch.

As for the location, either there, or at the bottom near the chat text box. That is where Grok and Claude put it in their UIs.

Thanks for the bug on the DAX code text being unreadable in anything but dark mode. Hopefully that will be fixed soon.