Add a user friendly error message for http exceptions

[grandbora]

What this PR does / why we need it:
Adds a user friendly error message to http exceptions that may happen when sending requests to the predictor node.

Example error log:

2024-12-12 12:12:12.333 37708 kserve ERROR [_http_predict():279] Could not send a request to predictor at url https://predictor/generate with headers {'Content-Type': 'application/json', 'x-request-id': 'xxxxx'} and with data b'{"inputs":"generate prompt text.","parameters":{"max_new_tokens":128,"temperature":0.9,"top_p":0.9,"top_k":50,"seed":12345,"details":true,"do_sample":true}}' due to exception [Errno 8] nodename nor servname provided, or not known

Type of changes
Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

Feature/Issue validation/testing:
Tested locally. Spun up a transformer and pointed it to a wrong url. Generated the log message above.

Special notes for your reviewer:
No image changes.

Checklist:

• Have you added unit/e2e tests that prove your fix is effective or that this feature works?
• Has code been commented, particularly in hard-to-understand areas?
• Have you made corresponding changes to the documentation?

Release note:

Not worth of a release note.

[grandbora]

cc @yuzisun @cmaddalozzo

[terrytangyuan]

See comment

[terrytangyuan]

/hold

[grandbora]

@terrytangyuan removed logging for potentially sensitive data.

[terrytangyuan]

/lgtm

[terrytangyuan]

Can you sign DCO?

[grandbora]

Yes, signing the DCO in a minute.

[spolti]

Nice addition, thanks!

[grandbora]

@terrytangyuan signed the DCO. Thank you.

[terrytangyuan]

/lgtm

[grandbora]

/assign @jinchihe

[grandbora]

@jinchihe would you mind approving this pr?

[grandbora]

@jinchihe @terrytangyuan @yuzisun is there anything else needs to be done for this pr?

[grandbora]

/unhold

[grandbora]

/assign @yuzisun

[grandbora]

/unassign @terrytangyuan

[grandbora]

/meow

[oss-prow-bot]

@grandbora:

In response to this:

/meow

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[grandbora]

@yuzisun @jinchihe I'd appreciate 👀 on this.

[terrytangyuan]

@grandbora You'll have to be a little more patient since the only active approver is @yuzisun right now.

[yuzisun]

/lgtm
/approve

[oss-prow-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: grandbora, spolti, terrytangyuan, yuzisun

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• python/kserve/OWNERS [yuzisun]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment