BUG: projects-update script not working

[azeemshaikh38]

@asraa @naveensrinivasan - the projects-update script (https://github.com/ossf/scorecard/blob/main/cron/data/update/main.go) which adds dependencies to the projects.csv file doesn't seem to be working and throws a lot of errors when run. Is this expected? What's the current status of this script?

[asraa]

Do you have logs? Dont' know the status but I can help diagnose

[azeemshaikh38]

You can run this at HEAD to reproduce:

make build-update-script && ./cron/data/update/projects-update ./cron/data/projects.csv

It's dumping out various errors like these:

2021/06/09 14:21:18 unable to parse the vanity URL bitbucket.org/creachadair/shell parsing bitbucket.org/creachadair/shell: XML syntax error on line 11: expected attribute name in element
2021/06/09 14:21:26 unable to parse the vanity URL git.apache.org/thrift.git parse https://git.apache.org/thrift.git?go-get=1: no go-import meta tags
2021/06/09 14:21:41 unable to parse the vanity URL  import path doesn't contain a hostname
2021/06/09 14:21:44 unable to parse the vanity URL bitbucket.org/creachadair/shell parsing bitbucket.org/creachadair/shell: XML syntax error on line 11: expected attribute name in element
2021/06/09 14:21:49 unable to parse the vanity URL git.apache.org/thrift.git parse https://git.apache.org/thrift.git?go-get=1: no go-import meta tags

[asraa]

:( I'm not sure why they're assumed to be vanity URLs if they're not github. @naveensrinivasan

[naveensrinivasan]

Some go repos aren't GitHub https://github.com/kubernetes/kubernetes/blob/master/go.mod#L12

[spencerschrock]

no longer needed as script was removed in #3269