Token cost managment

[parmsam-pfizer]

How do we manage token cost and usage within our organizations, especially as we start adopting more agentic workflows for clinical reporting? This is timely as major LLM model providers like GitHub Copilot have changed billing plans and companies are increasing their token usage.

https://github.blog/changelog/2026-06-01-updates-to-github-copilot-billing-and-plans/

[harveyl888]

Links with some of the other roundtable proposals, such as benchmarking (will a cheaper model do) and the promise of local-LLMs. 128GB laptops cost $5K-$7K and can run fairly sophisticated local models. Could there be a future where work is split between local, on-prem and cloud approaches?