Skip to content

feat: retry logic on chunks stream requests#83

Merged
TordAreStromsnes merged 2 commits intomainfrom
feat/retry-logic-on-chunks
Mar 13, 2026
Merged

feat: retry logic on chunks stream requests#83
TordAreStromsnes merged 2 commits intomainfrom
feat/retry-logic-on-chunks

Conversation

@TordAreStromsnes
Copy link
Copy Markdown
Contributor

Bulk Data Streaming Reliability:

  • Added a stream_retries parameter to get_bulk_data_stream and the underlying _request_binary_stream method, enabling automatic retries for transient failures during streaming. Retries resume after the bytes already yielded, assuming deterministic endpoint behavior.
  • Updated internal streaming logic to track progress and handle resuming streams after failures, with incremental backoff between retry attempts.

Documentation and Example Improvements:

  • Updated docstrings, guides, and API documentation to describe the new stream_retries parameter, explain its usage, and clarify that streaming timeouts apply to connection setup and waiting for new bytes, not the total download duration.
  • Expanded usage examples in README.md, guides, and API docs to demonstrate how to use stream_retries and set appropriate timeouts when streaming large binary datasets.

Configuration and Example Consistency:

  • Updated DSIS configuration examples across documentation and code samples to consistently include the dsis_site parameter and to use the correct environment (e.g., "qa" or "prod") as appropriate for the context.

Other Documentation Cleanups:

  • Removed redundant model_name and model_version from some guide examples to prevent confusion.
  • Clarified explanations for null value handling and memory management in binary data guides.

@TordAreStromsnes TordAreStromsnes merged commit c8f7e39 into main Mar 13, 2026
10 checks passed
@TordAreStromsnes TordAreStromsnes deleted the feat/retry-logic-on-chunks branch March 13, 2026 09:23
TordAreStromsnes pushed a commit that referenced this pull request Mar 13, 2026
🤖 I have created a release *beep* *boop*
---


##
[1.6.0](v1.5.0...v1.6.0)
(2026-03-13)


### Features

* retry logic on chunks stream requests
([#83](#83))
([c8f7e39](c8f7e39))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants