Skip to content

fix: 7468 deepen might fail on some repos with certain time ranges#7489

Merged
abeizn merged 1 commit into
mainfrom
kw-7468-gitext-deepen-may-fail
May 20, 2024
Merged

fix: 7468 deepen might fail on some repos with certain time ranges#7489
abeizn merged 1 commit into
mainfrom
kw-7468-gitext-deepen-may-fail

Conversation

@klesh
Copy link
Copy Markdown
Contributor

@klesh klesh commented May 20, 2024

Summary

fix: 7468 deepen might fail on some repos with certain time ranges

Does this close any open issues?

Closes #7468

Screenshots

❯ go run plugins/gitextractor/gitextractor.go -l https://github.com/RobertAudi/zsh-hooks -i test -a 2017-09-14T05:39:08Z
time="2024-05-20 13:44:17" level=debug msg=" [migrator] skipping previously executed migration script: create init 
...
time="2024-05-20 13:44:17" level=info msg="start plugin"
time="2024-05-20 13:44:17" level=info msg=" [gitextractor.PrepareTaskData] UseGoGit: false"
time="2024-05-20 13:44:17" level=info msg=" [gitextractor.PrepareTaskData] SkipCommitStat: false"
time="2024-05-20 13:44:17" level=info msg=" [gitextractor.PrepareTaskData] SkipCommitFiles: true"
time="2024-05-20 13:44:17" level=info msg="total step: 4"
time="2024-05-20 13:44:17" level=info msg="executing subtask Clone Git Repo"
time="2024-05-20 13:44:17" level=debug msg=" [Clone Git Repo] [gitcli] git [clone https://github.com/RobertAudi/zsh-hooks /tmp/gitextractor1644000499 --bare --progress --shallow-since=2017-09-14T05:39:08Z]"
time="2024-05-20 13:44:20" level=info msg="finished step: 1 / 4"
time="2024-05-20 13:44:20" level=info msg="executing subtask Collect Commits"
time="2024-05-20 13:44:20" level=info msg=" [Collect Commits] total jobs: 7"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 2a9f56433c86b332df367f6a350026e1e91035a6"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] missing BatchSave for type CommitParent"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] deleting outdate records for CommitParent"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 9\n"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] missing BatchSave for type Account"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] deleting outdate records for Account"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] missing BatchSave for type Commit"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] deleting outdate records for Commit"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] missing BatchSave for type RepoCommit"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] deleting outdate records for RepoCommit"
time="2024-05-20 13:44:20" level=info msg=" [Collect Commits] finished records: 1"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 0d5f1bd6587fe36506fd80e5f34a96e04b8134a9"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 9\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 2"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 06e535865060e757d49fe387401231bbcdb7c0ed"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 18\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 3"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 1ef9ba0c612c25405ec79b08f161af939209bd88"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 0\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 4"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: f59eed49cafc1b986a593a153714d3896c194a65"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 17\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 5"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 4229e66ab5122c81548aad8263e5bccc36705307"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 0\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 6"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] process commit: 9301f4e3a16df8e7cf8f37b5b93a7b925d8c8bee"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] state: 0\n"
time="2024-05-20 13:44:20" level=debug msg=" [Collect Commits] finished records: 7"
time="2024-05-20 13:44:20" level=info msg="finished step: 2 / 4"
time="2024-05-20 13:44:20" level=info msg="executing subtask Collect Branches"
time="2024-05-20 13:44:20" level=info msg=" [Collect Branches] total jobs: 0"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] missing BatchSave for type Ref"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [batch divider] deleting outdate records for Ref"
time="2024-05-20 13:44:20" level=info msg=" [Collect Branches] finished records: 1"
time="2024-05-20 13:44:20" level=info msg="finished step: 3 / 4"
time="2024-05-20 13:44:20" level=info msg="executing subtask Collect Tags"
time="2024-05-20 13:44:20" level=info msg=" [Collect Tags] total jobs: 0"
time="2024-05-20 13:44:20" level=info msg="finished step: 4 / 4"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [*code.CommitParent] batch save flush total 6 records to database"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [*crossdomain.Account] batch save flush total 4 records to database"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [*code.Commit] batch save flush total 7 records to database"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [*code.RepoCommit] batch save flush total 7 records to database"
time="2024-05-20 13:44:20" level=debug msg=" [Clone Git Repo] [*code.Ref] batch save flush total 1 records to database"

incubator-devlake/backend on  kw-7468-gitext-deepen-may-fail:main [$!] via  v1.22.0 on   (us-west-1) took 4s 
❯ 

@dosubot dosubot Bot added size:S This PR changes 10-29 lines, ignoring generated files. component/plugins This issue or PR relates to plugins pr-type/bug-fix This PR fixes a bug severity/p1 This bug affects functionality or significantly affect ux labels May 20, 2024
@dosubot dosubot Bot added the lgtm This PR has been approved by a maintainer label May 20, 2024
@abeizn abeizn merged commit e9b3afd into main May 20, 2024
@abeizn abeizn deleted the kw-7468-gitext-deepen-may-fail branch May 20, 2024 06:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/plugins This issue or PR relates to plugins lgtm This PR has been approved by a maintainer pr-type/bug-fix This PR fixes a bug severity/p1 This bug affects functionality or significantly affect ux size:S This PR changes 10-29 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug][GitHub] GitExtractor fails on empty repository due to shallow clone

2 participants