Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make the number of DynamoDB connections configurable #7751

Merged
merged 2 commits into from
May 12, 2024
Merged

Conversation

itaiad200
Copy link
Contributor

It will allow installations to adjust their DDB usage to their loads.

@itaiad200 itaiad200 added the include-changelog PR description should be included in next release changelog label May 10, 2024
Copy link

No linked issues found. Please add the corresponding issues in the pull request description.
Use GitHub automation to close the issue when a PR is merged

Copy link

github-actions bot commented May 10, 2024

♻️ PR Preview 4e95866 has been successfully destroyed since this PR has been closed.

🤖 By surge-preview

Copy link

E2E Test Results - DynamoDB Local - Local Block Adapter

13 passed

Copy link
Contributor

@guy-har guy-har left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -57,6 +57,8 @@ This reference uses `.` to denote the nesting of values.
+ **Note:** `endpoint` `aws_region` `aws_access_key_id` `aws_secret_access_key` are not required and used mainly for experimental purposes when working with DynamoDB with different AWS credentials.
{: .note }
+ `database.dynamodb.health_check_interval` `(duration : 0s)` - Interval to run health check for the DynamoDB instance (won't run if equal to 0).
+ `database.dynamodb.max_attempts` `(int : 10)` - The maximum number of attempts to perform on a DynamoDB request
+ `database.dynamodb.max_connections` `(int : 0)` - The maximum number of connections to DynamoDB. 0 means no limit.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we sure we want to change the default to unlimited?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I don't think we should have a default limitation on one of the system's bottlenecks: the kv store.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unless I'm missing something

@arielshaqed arielshaqed changed the title Make the number of DyanmoDB connections configurable Make the number of DynamoDB connections configurable May 12, 2024
@itaiad200 itaiad200 added the minor-change Used for PRs that don't require issue attached label May 12, 2024
@itaiad200 itaiad200 merged commit 53ab3b4 into master May 12, 2024
38 of 42 checks passed
@itaiad200 itaiad200 deleted the expr/ddb branch May 12, 2024 15:33
emulatorchen pushed a commit to emulatorchen/lakeFS that referenced this pull request May 27, 2024
* Change MaxConnectionsPerHost DDB

* Change config param name
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
include-changelog PR description should be included in next release changelog minor-change Used for PRs that don't require issue attached
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants