Skip to content

Add Resiliency to Repo Batch Fetch#399

Merged
SUSTAPLE117 merged 5 commits intomainfrom
maint/handle500sGH
Mar 26, 2026
Merged

Add Resiliency to Repo Batch Fetch#399
SUSTAPLE117 merged 5 commits intomainfrom
maint/handle500sGH

Conversation

@SUSTAPLE117
Copy link
Copy Markdown
Contributor

more resilient to failed networks during analyze org repo batch fetch

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR aims to make organization repository batch fetching more resilient to transient network/server failures during analysis by adding retry logic in the GitHub and GitLab SCM clients, and by changing how batch-fetch errors are handled during AnalyzeOrg.

Changes:

  • Add retry-with-backoff around GitHub GraphQL org repo pagination queries.
  • Add retry-with-backoff around GitLab group projects listing calls.
  • Change AnalyzeOrg to log and continue on repo batch fetch errors instead of returning immediately.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
providers/gitlab/client.go Adds retry loop + retryability check for ListGroupProjects calls.
providers/github/client.go Adds retry loop + retryability check for GitHub GraphQL GetOrgRepos.
analyze/analyze.go Changes org analysis behavior to skip errored repo batches rather than failing fast.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread analyze/analyze.go
Comment thread providers/gitlab/client.go Outdated
Comment thread providers/github/client.go Outdated
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread providers/github/client.go
Comment thread providers/gitlab/client.go Outdated
Comment thread providers/github/client.go
Comment thread analyze/analyze.go
Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 5 changed files in this pull request and generated 2 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread providers/github/client.go
Comment thread providers/gitlab/client.go
Copy link
Copy Markdown
Contributor

@fproulx-boostsecurity fproulx-boostsecurity left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great

@SUSTAPLE117 SUSTAPLE117 merged commit 73de8c2 into main Mar 26, 2026
15 checks passed
@SUSTAPLE117 SUSTAPLE117 deleted the maint/handle500sGH branch March 26, 2026 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants