Perf: race condition for in flight cache

[davidmurdoch]

We check the in flight cache, the memory cache, then check the persistent cache asynchronously, then insert into the in flight cache.

In rare circumstances this might allow multiple requests for the same data to be fired off to the upstream provider, when there should only be one.