Automate/autotune eviction_policy

[jansel]

We should autotune over different eviction policies. Many of these can be automated with heuristics, but when the correct choice isn't clear we should expose it to the autotuner.

[yf225]

Tagged ptc2025 because it's essential for rms_norm to catch up with torch.compile performance.

[oulgen]

I'll focus on this upcoming week since it is blocking perf