Loadgen needs to be updated to help support and enforce the no-sorting outside of the dataset rules for LLMs #2172
Description
Options
- Send the size of the original dataset to the SUT
- Verification of the order that queries were responded by loadgen. Potentially introduce a new test for this.
- Handle it in loadgen next