[perf] Reduce eval local to remote tracking latency by caching the arm token

[perf] Reduce eval local to remote tracking latency by caching the arm token #15316