The underlying problem causing these tests to fail needs to be fixed. _Originally posted by @grzegorz-roboflow in https://github.com/roboflow/inference/pull/888#discussion_r1893939943_