The Auto-cache was removed in 435a63b
I added new benchmark #1855
Before the change the time taken by this benchmark was 2.8sec (after converting to api version and making label as key instead of R4)
After the removal of the cache The time went upto 10s. But after the adding the cache check point me and @wschin was able to reduce it to 3.8s which is still regressed from 2.8s.