Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(Query, ChangeFeed): Provide ability to specify max Request Charge budget #1763

Open
bartelink opened this issue Aug 8, 2020 · 2 comments
Labels
ChangeFeed customer-reported Issue created by a customer discussion-wanted Need a discussion on an area feature-request New feature or request QUERY

Comments

@bartelink
Copy link
Contributor

Is your feature request related to a problem? Please describe.
When running a changefeed, or other query-based polling that's secondary to the core processing, the core mechanism the API provides is to have responses/continuations grouped by number of items returned. When items vary in size, the load a consumer places on the Container is subject to spikes and inconsistency.

Describe the solution you'd like
When items vary in size, being able to express the limit as a maximum RU cost you're willing to incur for a given query (in lieu of specifying a MaxItems that's guaranteed to be within the limit) more directly expresses the need.

Describe alternatives you've considered
The main workaround to date is to use an artificially low MaxItems in the query, and then pause querying based on a leaky bucket. However esp with CFP, that a) doesnt provide the best throughput and b) relies on #616

Additional context
Being able to express the constraint at the CosmosDB core request level was covered in a conference call some time back and agreed to in principle. Raising it here as I believe this to be a very important facility in general, as it allows in a much broader set of use cases for subscriptions and/or syncing pipelines.

@j82w j82w added ChangeFeed customer-reported Issue created by a customer discussion-wanted Need a discussion on an area feature-request New feature or request QUERY labels Aug 10, 2020
@timsander1
Copy link
Contributor

Hi @bartelink , this use case makes sense. Thank you for submitting this feedback. We'll consider this in our planning during the upcoming six month period, but as of now, this is unplanned.

@bartelink
Copy link
Contributor Author

Still looking for this, 3 years on (reminded of it by https://devblogs.microsoft.com/cosmosdb/introducing-priority-based-execution-in-azure-cosmos-db-preview, which would slot in alongside nicely in terms of smoothing out the effects of competing workflows)

@bartelink bartelink changed the title Query, Changefeed: Provide ability to specify max Request Charge budget feat(Query, ChangeFeed): Provide ability to specify max Request Charge budget Aug 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ChangeFeed customer-reported Issue created by a customer discussion-wanted Need a discussion on an area feature-request New feature or request QUERY
Projects
Status: Triage
Development

No branches or pull requests

3 participants