Capacity Planning

Scale Enterprise Workloads

Value Proposition Achieve multi-agent concurrency and maximize token efficiency through intelligent connection pooling, in-memory schema caching, and configurable data payloads designed to sustain enterprise operations.

1. 🛜 Connection Pooling

• Connection lifecycle: mysql2 keeps idle connections alive. There is no idle timeout in the pool. Connections persist until the server process exits or MySQL closes them via wait_timeout.

Tip

Set --pool-size based on concurrent AI tool calls. The default size of 10 is fully configurable for your single-agent or multi-agent setup.

2. ⚡ Schema Caching

The server caches schema metadata in memory. This accelerates execution by eliminating redundant INFORMATION_SCHEMA queries and reducing database overhead.

• Default TTL: Configurable via METADATA_CACHE_TTL_MS (defaults to 30000 ms).
• Footprint: Moderate schema metadata consumes minimal memory (e.g., a few megabytes).
• Invalidation: DDL tools automatically invalidate the cache upon execution.

Recommended TTLs

Environment	TTL	Rationale
Production (stable schema)	300000 (5 min) or higher	Eliminates introspection overhead during AI reasoning
Active development	5000–30000 (5–30 s)	Keeps AI in sync with frequent schema changes
Migration runs	0 (disabled)	Guarantees fresh metadata after every DDL statement

export METADATA_CACHE_TTL_MS=300000

3. 🏥 Database Maintenance

As AI agents repeatedly modify data, InnoDB tables may accumulate fragmentation. Regular maintenance workflows help preserve high throughput and reduce long-term system overhead.

OPTIMIZE TABLE

Because InnoDB does not automatically reclaim disk space from deleted rows, optimize your storage footprint by using OPTIMIZE TABLE to rebuild tables and indexes, defragmenting your data files.

• When to use: After large bulk deletes, archival operations, or significant churn.
• How: Use the generic mysql_write_query or mysql_execute_code tools.
• Note: OPTIMIZE TABLE locks the table. It remains I/O-intensive. Schedule this during low-traffic windows.

ANALYZE TABLE

• When to use: After bulk loads that change data distribution significantly. Stale statistics cause the query optimizer to choose suboptimal indexes.
• How: Use the generic mysql_write_query or mysql_execute_code tools.
• Note: For newer MySQL environments, consider using histogram statistics. Use ANALYZE TABLE ... UPDATE HISTOGRAM ON .... Do this for columns with skewed distributions.

Partitioned Tables

Consider range partitioning for large tables or time-series segments. Use the generic mysql_write_query or mysql_execute_code tools to manage them. Benefits:

• Partition pruning reduces scan scope for time-bounded queries.
• ALTER TABLE ... DROP PARTITION is instant. This is compared to DELETE FROM ... WHERE date < X.

4. 🚀 Buffer Pool Optimization

The InnoDB buffer pool is MySQL's primary memory cache. Its size directly impacts query performance and supports enterprise-scale AI data operations.

• Monitoring: Use mysql_buffer_pool_stats to query performance metrics. Inspect hit rates, dirty page ratios, and free buffers.
• Sizing rule of thumb: Set innodb_buffer_pool_size to 70–80% of available RAM on a dedicated MySQL server.
• Hit rate target: A hit rate below 99% indicates a pool too small for the working set. Use mysql_buffer_pool_stats to review this metric.

Note

Administrators should use the pre-configured Grafana dashboard. This aids ongoing capacity planning. It visualizes buffer pool stats. This reduces constant manual polling.

5. 🪙 Token Efficiency

• Cost Optimization: Transmitting raw query results to LLMs incurs scaling limits and cost bottlenecks. Code Mode addresses this by aggregating data server-side to reduce context size and token consumption. For Code Mode rate limiting, consider Redis memory usage and scaling requirements.
• Granular limits: Granular tool-level arguments efficiently enforce row limits on read queries, delivering precise control over context windows without relying on restrictive global server defaults. Code Mode strictly enforces a global payload boundary (CODEMODE_MAX_RESULT_SIZE).
• Cursor pagination: Leverage keyset-based cursor pagination for scanning large tables instead of traditional OFFSET, which inefficiently forces MySQL to scan and discard rows. Cursor pagination executes in optimal O(1) time on indexed columns, ensuring consistent performance regardless of table size.
• Token-saving flags: Many tools support compact, summary, and limit flags. These provide a significant reduction in token overhead. Truncating tools return limited and totalAvailable flags. This informs agents about capped results.

---

See also: Performance-Tuning · Configuration · Tool Filtering