Skip to content

Change default value for Cosmos BulkWriter progress interval check#44773

Closed
c21 wants to merge 2 commits intoAzure:mainfrom
c21:progress
Closed

Change default value for Cosmos BulkWriter progress interval check#44773
c21 wants to merge 2 commits intoAzure:mainfrom
c21:progress

Conversation

@c21
Copy link

@c21 c21 commented Mar 24, 2025

Description

The default value for maxNoProgressIntervalInSeconds and maxRetryNoProgressIntervalInSeconds looks to be wrong, compared to https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/cosmos/azure-cosmos-spark_3_2-12/src/main/scala/com/azure/cosmos/spark/CosmosConfig.scala#L1181-L1182 .

The issue we are seeing is during FlushAndClose, BulkWriter has thrown exceptions in Spark tasks.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

@c21 c21 requested review from a team and kirankumarkolli as code owners March 24, 2025 20:05
@github-actions github-actions bot added Community Contribution Community members are working on the issue Cosmos customer-reported Issues that are reported by GitHub users external to the Azure organization. labels Mar 24, 2025
@github-actions
Copy link
Contributor

Thank you for your contribution @c21! We will review the pull request and get back to you soon.

@c21
Copy link
Author

c21 commented Mar 25, 2025

@microsoft-github-policy-service agree

@FabianMeiswinkel
Copy link
Member

This change has been merged in PR #44992

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Community Contribution Community members are working on the issue Cosmos customer-reported Issues that are reported by GitHub users external to the Azure organization.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants