OpenAPI allows different models per response code, including 4xx responses. However, openapi-common does not deserialize these responses, it just attaches the raw JSON to the exception object.
We should see if we can deserialize the response and attach that to the exception instead.