Inline chat slow with claude models

[jrieken]

With 1.107 we see slower inline chat response times. We suspect this is due to an EXP that controls the thinking of claude models. We need to make a fix here because inline chat users are very performance sensitive. Options

• tweak the code so that only agentic usages of claude get the thinking budget
• tweak the code so that hardcodes a location check somewhere
• tweak the EXP

[amunger]

@bhavyaus is there a way to verify this through logs, or just based on timing

[amunger]

seems pretty quick, but let me know if there's something more to check