I am studying how Vidur determines bottlenecks, and I noticed that both TFFTViolationLowMaxBatchSizeCase and TFFTViolationLowMemoryCase involve checking batch_size_obs. It seems that batch_size_obs should be a specific batch size value, but in TFFTViolationLowMemoryCase, it is directly compared with LOW_MEMORY_BATCH_SIZE_THRESHOLD. Could this be a mistake?
I am studying how Vidur determines bottlenecks, and I noticed that both TFFTViolationLowMaxBatchSizeCase and TFFTViolationLowMemoryCase involve checking batch_size_obs. It seems that batch_size_obs should be a specific batch size value, but in TFFTViolationLowMemoryCase, it is directly compared with LOW_MEMORY_BATCH_SIZE_THRESHOLD. Could this be a mistake?