Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

Conversation

@burmudar
Copy link
Contributor

@burmudar burmudar commented Nov 10, 2022

Due to the large amount of repos on certain orgs, it takes a LONG time to fetch all of the repos before we start updating them.

This reworks how repos are fetched, by fetching a batch and then updating that batch.

Closes #44141

Test plan

Tested locally / remotely too (80k repos converted so far)

@burmudar burmudar requested review from a team and jhchabran November 10, 2022 12:07
@burmudar burmudar self-assigned this Nov 10, 2022
@cla-bot cla-bot bot added the cla-signed label Nov 10, 2022
@sourcegraph-bot
Copy link
Contributor

sourcegraph-bot commented Nov 10, 2022

Codenotify: Notifying subscribers in OWNERS files for diff ba327d5...528f308.

Notify File(s)
@sourcegraph/dev-experience dev/scaletesting/bulkreposettings/main.go

Copy link
Contributor

@jhchabran jhchabran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Mostly nits comments, don't wait for a second round if you decide to fix them.

@jhchabran jhchabran changed the title scaltesting: bulkreposettings - allow repos to be incrementally fetched and updated scaletesting: bulkreposettings - allow repos to be incrementally fetched and updated Nov 15, 2022
burmudar and others added 5 commits November 15, 2022 08:55
Co-authored-by: Jean-Hadrien Chabran <jh@chabran.fr>
Co-authored-by: Jean-Hadrien Chabran <jh@chabran.fr>
Co-authored-by: Jean-Hadrien Chabran <jh@chabran.fr>
Co-authored-by: Jean-Hadrien Chabran <jh@chabran.fr>
Co-authored-by: Jean-Hadrien Chabran <jh@chabran.fr>
@burmudar burmudar merged commit cc7bd73 into main Nov 17, 2022
@burmudar burmudar deleted the wb/bulksettings-concurrent branch November 17, 2022 13:12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Scaletesting: Create 200k blank repos on GHE scaletesting

4 participants