Add tokenCache configuration option #119
Description
Add tokenCache configuration option
Description
Add a new configuration option called tokenCache to control whether token caching is enabled in API calls. The default value should be true to maintain current behavior.
When set to false, the CLI should bypass adding cache-control metadata to messages when calling the LLM API.
Implementation Details
- Add
tokenCache: booleanto the configuration schema with a default value oftrue - Modify the toolAgentCore.ts to conditionally apply cache control based on this setting
- Update documentation to reflect the new option
Motivation
The current token caching mechanism may be causing issues in certain scenarios. This option will allow users to bypass the cache control when needed for troubleshooting or when using models that don't support it.
Additional Notes
The current tracking of cache tokens may be broken, so validation through log messages might not be reliable.