Private repository submodule sync failed. #14

socar-baegoon · 2019-08-16T06:16:32Z

yml setting.

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@master
      with:
        ref: develop
        submodules: true

actions log

Please fix it. 🙏

TingluoHuang · 2019-08-16T14:54:53Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

elan · 2019-08-18T01:56:25Z

Tried that and it didn't work.

Cloning into '/home/runner/work/xxx/xxx/player'...
remote: Repository not found.
fatal: repository 'https://github.com/yyy/zzz/' not found

socar-baegoon · 2019-08-19T07:29:09Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

This issue occurs not because of ssh, but because of private repository.
submodule is in the same owner's repository, but the issue occurs. 😢

elan · 2019-08-19T07:59:03Z

(In my case it's a different owner—org vs personal—but still can't make it work. All are private repos.)

maxilevi · 2019-08-20T02:53:40Z

This is happening to me too. I've tried setting the token input but it didn't work either.

TingluoHuang · 2019-08-20T14:34:51Z

@maxilevi have your try set token to be your PAT? the default GITHUB_TOKEN might not have permission to your submodules repo.

maxilevi · 2019-08-20T16:25:26Z

@TingluoHuang Yes, I've created a new PAT with full repo access and added it as a secret to the repository. Then I called the action this way:

- uses: actions/checkout@v1
   with:
      token: ${{ secrets.HEDRA_CI }}
      submodules: true

And it fails with the following error (same as the other guys):

Host key verification failed.
##[error]fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
##[error]fatal: clone of 'git@github.com:maxilevi/zzz.git' into submodule path 'D:/a/yyy/zzz' failed
Failed to clone 'zzz'. Retry scheduled

TingluoHuang · 2019-08-20T16:56:12Z

@maxilevi your submodules are configured via ssh, can you try add them as https?

maxilevi · 2019-08-21T03:41:54Z

@TingluoHuang Thank you, it works now. Any plans on supporting ssh?

socar-baegoon · 2019-08-21T04:37:26Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

Thank you! It works!

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@master
      with:
        ref: develop
        token: ${{ secrets.BAEGOON_TOKEN }}
        submodules: true

[submodule "subprojects/protocol/src/main/proto"]
	path = subprojects/protocol/src/main/proto
	url = https://github.com/owner/protocol.git

socar-baegoon · 2019-08-21T05:46:46Z

I will close this issue.
Thank you for everybody help. ❤️

joeshaw · 2019-08-22T13:53:35Z

I ran into this same issue and made a slightly different tweak. As part of my workflow I use .gitconfig to tweak the URLs. That way I don't have to switch from using the git protocol to https in my .gitmodules file and affect my development setup.

As my first step in my YAML file, before running actions/checkout with submodules: true:

    - name: Fix up git URLs
      run: echo -e '[url "https://github.com/"]\n  insteadOf = "git@github.com:"' >> ~/.gitconfig

@TingluoHuang I feel like this issue should be reopened if it's not the desired behavior, and if it is I think it needs to be better documented. I can open another issue if that is desirable.

TingluoHuang · 2019-08-22T13:58:43Z

@joeshaw i am in the process of documenting all these problems.

jinzishuai · 2019-08-26T23:06:08Z

Hi there, I am having exactly the same issue here.
Although my submodule is configured to use https

All submodules are authenticated using the same credentials so I wonder why GITHUB_TOKEN does not work.

socar-baegoon · 2019-08-27T01:01:20Z

@jinzishuai

Hi there, I am having exactly the same issue here.
Although my submodule is configured to use https

All submodules are authenticated using the same credentials so I wonder why GITHUB_TOKEN does not work.

Please refer to this link.
#14 (comment)

and please use this link to create a token.
https://help.github.com/en/articles/creating-a-personal-access-token-for-the-command-line

jinzishuai · 2019-08-28T01:28:50Z

Please refer to this link.
#14 (comment)

and please use this link to create a token.
https://help.github.com/en/articles/creating-a-personal-access-token-for-the-command-line

@socar-baegoon Thank you. I got it working following your instructions.

sunt05 · 2019-09-01T19:24:41Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

Thank you! It works!

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@master
      with:
        ref: develop
        token: ${{ secrets.BAEGOON_TOKEN }}
        submodules: true

[submodule "subprojects/protocol/src/main/proto"]
	path = subprojects/protocol/src/main/proto
	url = https://github.com/owner/protocol.git

This should be added into the manual page.

rcoup · 2019-11-13T12:30:00Z

If this helps anyone, this is working for me:

using a/the github token
to clone a URL accessed via git@github.com/user/repo.git (maybe via submodules/homebrew/a script/something else)
in GH actions
with runs-on: [macOS-latest]

# disable the keychain credential helper
git config --global credential.helper ""
# enable the local store credential helper
git config --global --add credential.helper store
# add credential
echo "https://x-access-token:${{ secrets.A_TOKEN }}@github.com" >> ~/.git-credentials
# tell git to use https instead of ssh whenever it encounters it
git config --global url."https://github.com/".insteadof git@github.com:
# do something
git clone git@github.com:user/repo.git

MaEtUgR · 2019-12-17T09:52:58Z

Big thanks to @rcoup for sharing the solution. I used it directly in the yml. Had to be careful because of the colon:

steps:
- uses: actions/checkout@v1 # without submodules
- name: disable the keychain credential helper
  run: git config --global credential.helper ""
- name: enable the local store credential helper
  run: git config --global --add credential.helper store
- name: add credential
  run: echo "https://x-access-token:${{ secrets.SUBMODULE_CLONE_TOKEN }}@github.com" >> ~/.git-credentials
- name: tell git to use https instead of ssh whenever it encounters it
  run: 'git config --global url."https://github.com/".insteadof git@github.com:'
- name: do smoething
  run: {that updates submodules}

see: actions/checkout#14

Use HTTPS url for ADL So that github action can pull it actions/checkout#14

trusktr · 2020-03-29T02:34:29Z

@joeshaw I'm having no luck with your approach.

I made a personal access token with the scope public_repo, then in my repo that has the submodules I created a secret called ACCESS_TOKEN and pasted the token in there.

This is what I have in my yaml file:

name: Node CI

on: [push]

jobs:
  build:

    runs-on: ubuntu-latest

    strategy:
      matrix:
        node-version: [13.x]

    steps:
    - run: echo -e '[url "https://github.com/"]\n  insteadOf = "git@github.com:"' >> ~/.gitconfig

    # I verified that the output looks fine
    - run: cat ~/.gitconfig

    - uses: actions/checkout@v1
      with:
        submodules: 'recursive'
        token: ${{ secrets.ACCESS_TOKEN }}

    - name: Use Node.js ${{ matrix.node-version }}
      uses: actions/setup-node@v1
      with:
        node-version: ${{ matrix.node-version }}
    - name: npm install, build, and test
      run: |
        npm i
        npm test
      env:
        CI: true

which results in the same errors as others above:

Host key verification failed.
##[error]fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
##[error]fatal: clone of 'git@bitbucket.org:infamous/element.git' into submodule path '/home/runner/work/umbrella/umbrella/packages/element' failed
Failed to clone 'packages/element'. Retry scheduled

Did I do something obviously wrong?

EDIT: I gave up, and converted all my git submodule URLs to https format inside .gitmodules. That worked fine.

joeshaw · 2020-03-29T18:12:12Z

@trusktr look carefully at your error message. It’s failing to pull from bitbucket, not github. You’ll need a similar insteadOf for it.

Use HTTPS url for ADL So that github action can pull it actions/checkout#14

h1manshug · 2020-07-02T07:27:53Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

Thank you! It works!

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@master
      with:
        ref: develop
        token: ${{ secrets.BAEGOON_TOKEN }}
        submodules: true

[submodule "subprojects/protocol/src/main/proto"]
	path = subprojects/protocol/src/main/proto
	url = https://github.com/owner/protocol.git

Not working for me

socar-baegoon · 2020-07-02T07:36:29Z

@socar-baegoon did you configure your submodule via ssh? can you try configure your submodule using https://github.com/org/repo format?

Thank you! It works!

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@master
      with:
        ref: develop
        token: ${{ secrets.BAEGOON_TOKEN }}
        submodules: true

[submodule "subprojects/protocol/src/main/proto"]
	path = subprojects/protocol/src/main/proto
	url = https://github.com/owner/protocol.git

Not working for me

This solution was a year ago.
I don't use submodules anymore.
If you continue to have difficulties, I recommend you to package and use the module.
Very easy!!! (https://docs.github.com/en/packages)

Good luck 👍

killthekitten · 2020-07-02T09:37:33Z

@h1manshug using ssh-key would be another option:

jobs:
  tests:
    steps:      
      - uses: actions/checkout@master
        with:
          ssh-key: ${{ secrets.CI_SSH_PRIVATE_KEY }}
          submodules: true

You might want to create a machine user to hold the ssh key for you.

xli140602 · 2021-05-11T22:22:10Z

this way the workflow can switch between https and ssh

[submodule "subprojects/protocol/src/main/proto"]
	path = subprojects/protocol/src/main/proto
	url = git@github.com:owner/protocol.git

(see actions/checkout#14)

see actions/checkout#14 (comment)

lencshu · 2023-04-23T10:25:53Z

it works for me as a solution 2023:

      - name: Checkout repository
        uses: actions/checkout@v2
        with:
          submodules: 'recursive'
          token: ${{ secrets.SUBMODULE_GITHUB_TOKEN }}

levifussell · 2023-07-25T15:08:31Z

@lencshu's solution worked for me. Created the access token on my personal repo, made sure to give it full read/write persmissions.

socar-baegoon closed this as completed Aug 21, 2019

rectalogic mentioned this issue Sep 8, 2019

Error when checking out a repository with private submodules #30

Closed

thorker mentioned this issue Sep 9, 2019

Submodules from private repositories #35

Closed

ghost mentioned this issue Sep 12, 2019

Recursive Submodules #34

Closed

rectalogic mentioned this issue Oct 28, 2019

checkout@v1 breaking change - overwrites ~/.gitconfig #60

Closed

ksauzz added a commit to ksauzz/dotfiles that referenced this issue Feb 3, 2020

action: checkout submodules

e8dc3b6

see: actions/checkout#14

ksauzz added a commit to ksauzz/dotfiles that referenced this issue Feb 3, 2020

action: checkout submodules

0e12a9c

see: actions/checkout#14

diversemix mentioned this issue Mar 6, 2020

Create github action publish.yml libero/reviewer-reporter#2

Merged

paul-thompson-helix added a commit to paul-thompson-helix/helix-adl-tools that referenced this issue Mar 14, 2020

Update .gitmodules

70bd8aa

Use HTTPS url for ADL So that github action can pull it actions/checkout#14

paul-thompson-helix added a commit to paul-thompson-helix/helix-adl-tools that referenced this issue Mar 25, 2020

Update .gitmodules

a7b7b53

Use HTTPS url for ADL So that github action can pull it actions/checkout#14

paul-thompson-helix added a commit to helix-collective/helix-adl-tools that referenced this issue Apr 20, 2020

Update .gitmodules

dc42a8b

Use HTTPS url for ADL So that github action can pull it actions/checkout#14

jdpipe added a commit to jdpipe/OpenModelica that referenced this issue Dec 4, 2021

add 'submodules: recursive'

2010d2d

(see actions/checkout#14)

monkins1010 added a commit to monkins1010/Verus-Desktop that referenced this issue Jan 11, 2022

new github security

74b298a

see actions/checkout#14 (comment)

praveenkumarct mentioned this issue Mar 30, 2022

Fix build issues commercetools/commercetools-bundles-starter#167

Merged

victoreronmosele mentioned this issue Apr 10, 2022

GitHub Actions Workflow Fails With "The unauthenticated git protocol on port 9418 is no longer supported." Bug victoreronmosele/flutter_gradient_generator#48

Closed

jww3 mentioned this issue Mar 15, 2023

force actions/checkout to use SSH rather than HTTPS? #1221

Open

re-mora mentioned this issue Jun 3, 2024

ci: remove submodule branch type project-porko/porko-service#81

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Private repository submodule sync failed. #14

Private repository submodule sync failed. #14

socar-baegoon commented Aug 16, 2019

TingluoHuang commented Aug 16, 2019

elan commented Aug 18, 2019

socar-baegoon commented Aug 19, 2019

elan commented Aug 19, 2019

maxilevi commented Aug 20, 2019

TingluoHuang commented Aug 20, 2019

maxilevi commented Aug 20, 2019

TingluoHuang commented Aug 20, 2019

maxilevi commented Aug 21, 2019

socar-baegoon commented Aug 21, 2019 •

edited

Loading

socar-baegoon commented Aug 21, 2019

joeshaw commented Aug 22, 2019 •

edited

Loading

TingluoHuang commented Aug 22, 2019

jinzishuai commented Aug 26, 2019

socar-baegoon commented Aug 27, 2019 •

edited

Loading

jinzishuai commented Aug 28, 2019

sunt05 commented Sep 1, 2019

rcoup commented Nov 13, 2019

MaEtUgR commented Dec 17, 2019 •

edited

Loading

trusktr commented Mar 29, 2020 •

edited

Loading

joeshaw commented Mar 29, 2020

h1manshug commented Jul 2, 2020

socar-baegoon commented Jul 2, 2020 •

edited

Loading

killthekitten commented Jul 2, 2020

xli140602 commented May 11, 2021 •

edited

Loading

lencshu commented Apr 23, 2023 •

edited

Loading

levifussell commented Jul 25, 2023

Private repository submodule sync failed. #14

Private repository submodule sync failed. #14

Comments

socar-baegoon commented Aug 16, 2019

TingluoHuang commented Aug 16, 2019

elan commented Aug 18, 2019

socar-baegoon commented Aug 19, 2019

elan commented Aug 19, 2019

maxilevi commented Aug 20, 2019

TingluoHuang commented Aug 20, 2019

maxilevi commented Aug 20, 2019

TingluoHuang commented Aug 20, 2019

maxilevi commented Aug 21, 2019

socar-baegoon commented Aug 21, 2019 • edited Loading

socar-baegoon commented Aug 21, 2019

joeshaw commented Aug 22, 2019 • edited Loading

TingluoHuang commented Aug 22, 2019

jinzishuai commented Aug 26, 2019

socar-baegoon commented Aug 27, 2019 • edited Loading

jinzishuai commented Aug 28, 2019

sunt05 commented Sep 1, 2019

rcoup commented Nov 13, 2019

MaEtUgR commented Dec 17, 2019 • edited Loading

trusktr commented Mar 29, 2020 • edited Loading

joeshaw commented Mar 29, 2020

h1manshug commented Jul 2, 2020

socar-baegoon commented Jul 2, 2020 • edited Loading

killthekitten commented Jul 2, 2020

xli140602 commented May 11, 2021 • edited Loading

lencshu commented Apr 23, 2023 • edited Loading

levifussell commented Jul 25, 2023

socar-baegoon commented Aug 21, 2019 •

edited

Loading

joeshaw commented Aug 22, 2019 •

edited

Loading

socar-baegoon commented Aug 27, 2019 •

edited

Loading

MaEtUgR commented Dec 17, 2019 •

edited

Loading

trusktr commented Mar 29, 2020 •

edited

Loading

socar-baegoon commented Jul 2, 2020 •

edited

Loading

xli140602 commented May 11, 2021 •

edited

Loading

lencshu commented Apr 23, 2023 •

edited

Loading