Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GithubDataSource based importers failing due to rate limit #507

Closed
Hritik14 opened this issue Jul 19, 2021 · 0 comments · Fixed by #508
Closed

GithubDataSource based importers failing due to rate limit #507

Hritik14 opened this issue Jul 19, 2021 · 0 comments · Fixed by #508
Assignees

Comments

@Hritik14
Copy link
Collaborator

Hritik14 commented Jul 19, 2021

The github rate limiting docs say

For unauthenticated requests, the rate limit allows for up to 60 requests per hour. Unauthenticated requests are associated with the originating IP address, and not the user making requests.

We're getting aiohttp.client_exceptions.ClientResponseError: 429, message='Too Many Requests'. Perhaps

  • Using github by api and using secret tokens or
  • Using subversion to fetch tags
    Could help us
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant