Verify accuracy of request metrics for a local deployment using multiple threads #1209
Description
Version
v0.18.*
Description
Support for multithreading and multiprocessing was recently added to Cortex local. Request metrics are tracked by increment files to a local directory. Multiprocessing with Cortex local may work as expected because each process writes to files prefixed with their PIDs. However, multithreading on Cortex local may be broken.
Add a mutex to request metrics files to prevent multiple threads from overwriting the same file with outdated values.