Skip to content

fix(github): auto-enrich missing URL fields in GitHub scopes#8661

Merged
klesh merged 2 commits into
apache:mainfrom
cedriclecoz:fix_gitextractor_missing_url
Feb 26, 2026
Merged

fix(github): auto-enrich missing URL fields in GitHub scopes#8661
klesh merged 2 commits into
apache:mainfrom
cedriclecoz:fix_gitextractor_missing_url

Conversation

@cedriclecoz
Copy link
Copy Markdown
Contributor

@cedriclecoz cedriclecoz commented Dec 12, 2025

Add automatic URL enrichment to PutScopes function to fetch missing htmlUrl and cloneUrl fields from GitHub API when only fullName is provided. This ensures gitextractor has the required URLs for cloning repositories.

  • Fetch repo details from GitHub API when URLs are missing
  • Populate htmlUrl and cloneUrl from API response
  • Add graceful error handling for inaccessible repos

⚠️ Pre Checklist

Please complete ALL items in this checklist, and remove before submitting

  • I have read through the Contributing Documentation.
  • I have added relevant tests.
  • I have added relevant documentation.
  • I will add labels to the PR, such as pr-type/bug-fix, pr-type/feature-development, etc.

Summary

What does this PR do?

  • Fetch repo details from GitHub API when URLs are missing
  • Populate htmlUrl and cloneUrl from API response
  • Add graceful error handling for inaccessible repos

Does this close any open issues?

Closes #8640

Add automatic URL enrichment to PutScopes function to fetch missing
htmlUrl and cloneUrl fields from GitHub API when only fullName is provided.
This ensures gitextractor has the required URLs for cloning repositories.

- Fetch repo details from GitHub API when URLs are missing
- Populate htmlUrl and cloneUrl from API response
- Add graceful error handling for inaccessible repos
@dosubot dosubot Bot added size:M This PR changes 30-99 lines, ignoring generated files. component/plugins This issue or PR relates to plugins pr-type/bug-fix This PR fixes a bug labels Dec 12, 2025
@cedriclecoz cedriclecoz changed the title fix: auto-enrich missing URL fields in GitHub scopes fix(github): auto-enrich missing URL fields in GitHub scopes Dec 12, 2025
Copy link
Copy Markdown
Contributor

@klesh klesh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
Thanks for your contribution.

@klesh klesh merged commit 3a1cf9c into apache:main Feb 26, 2026
9 of 10 checks passed
zvika-finally pushed a commit to zvika-finally/incubator-devlake that referenced this pull request Apr 30, 2026
Add automatic URL enrichment to PutScopes function to fetch missing
htmlUrl and cloneUrl fields from GitHub API when only fullName is provided.
This ensures gitextractor has the required URLs for cloning repositories.

- Fetch repo details from GitHub API when URLs are missing
- Populate htmlUrl and cloneUrl from API response
- Add graceful error handling for inaccessible repos
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/plugins This issue or PR relates to plugins pr-type/bug-fix This PR fixes a bug size:M This PR changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug][GitExtractor] GitExtractor fails with "Invalid Git URL" when using GitHub App authentication

2 participants