Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

concurrency limit #35

Open
yanggaosc opened this issue May 9, 2018 · 3 comments
Open

concurrency limit #35

yanggaosc opened this issue May 9, 2018 · 3 comments

Comments

@yanggaosc
Copy link

Thank you for providing this handy library!

I notice that you keep a local counter of calls, and will queue queries when the concurrency limit is hit.

Just curious why? Athena has its own way of queueing, and would not fail the queries either.

Thanks!

Yang

@yanggaosc
Copy link
Author

yanggaosc commented May 9, 2018

maybe it is for keeping alive a line of super long queries that would take more than 30 minutes, which is the AWS athena default timeout?

@KoteiIto
Copy link
Owner

I thought that errors will be returned from aws sdk when the service limit is exceeded.

https://docs.aws.amazon.com/athena/latest/ug/service-limits.html

Is there documentation about Athena queuing query?

@yanggaosc
Copy link
Author

seems that the concurrency limit is per server? what if I have 100 servers running your library?

yang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants