Skip to content

Set retry=True for InferenceClient.create_inference_request #130

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Jul 4, 2022
Merged

Set retry=True for InferenceClient.create_inference_request #130

merged 3 commits into from
Jul 4, 2022

Conversation

@mhaas
Copy link
Contributor

@mhaas mhaas commented Jul 4, 2022 •
edited
Loading

... and InferenceClient.create_inference_request_with_url.

This greatly improves reliability.

Checks:

  • README.md is maintained
  • Documentation is maintained
  • CHANGELOG.md is updated
  • Tests added

mhaas added 2 commits July 4, 2022 14:06
@mhaas
Set retry=True for InferenceClient.create_inference_request
2de1fa1 
... and InferenceClient.create_inference_request_with_url.

This greatly improves reliability.
@mhaas
Maintain changelog for 0.13.0
52aab3f
@mhaas mhaas requested a review from SreevishnuAB July 4, 2022 12:10
SreevishnuAB
SreevishnuAB suggested changes Jul 4, 2022
View reviewed changes
Copy link
Contributor

@SreevishnuAB SreevishnuAB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@SreevishnuAB SreevishnuAB self-requested a review July 4, 2022 12:18
@mhaas mhaas merged commit 62a9509 into main Jul 4, 2022
@mhaas mhaas deleted the inference_retry_default branch July 4, 2022 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@SreevishnuAB SreevishnuAB SreevishnuAB approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mhaas @SreevishnuAB