Test verifying signed extensions

[sandy081]

Refs: #162284

• macOS: @rzhao271 (x64)
• macOS: @alexdima (arm64)
• win: @rebornix (ia32)
• win: @joyceerhl (x64)
• win: @jrieken (arm64)
• linux: @aeschli (x64)
• linux: @chrmarti (arm)
• linux: @alexdima (arm64)

Complexity: 3

Create Issue

---

Set Up

Enable extension sign verification by adding following settings

"extensions.verifySignature": true,
"_extensionsGallery.enablePPE": true

Restart insiders.

Note: Do not forget to remove this setting _extensionsGallery.enablePPE after testing, so that you can use actual Marketplace.

Testing

Do not test installing regular extensions - this is expected to not work due to this setup. Only try with the extensions below.

• Open the Log (Shared) Output channel.
• Install at least 6 of the following extensions and make sure that the extension is installed properly and that "verified extension" message is logged in the output channel. Eg: Verified extension: nikhgup1.component-creator true
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.component-creator
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.xml1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.JavaScriptSnippets123
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.vscode-pull-request-github123
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.theme-dracula123
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.appmap123
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.todo-tree1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.material-icon-theme1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.vscode-thunder-client1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.rest-client1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.calva1298
  • https://marketplace.vsallin.net/items?itemName=nikhgup1.godot-tools1298

[weinand]

@sandy081 since I don't have access to an macOS ARM, I've removed my assignment

[isidorn]

This test plan item is NOT yet ready for testing. We are waiting for a Marketplace deployment that should ideally happen by tomorrow. I will update the test plan item as we get updates from the marketplace team. Sorry about this.

[isidorn]

This test plan item will be ready for testing on Wednesday (or if we get the next VS Code insiders before that). Sorry about the delay.

[paulacamargo25]

Tomorrow I go on vacation so I won't be able to test the TPI.

[sandy081]

Latest insiders is available now and you can test it now. Thanks.

[isidorn]

Update: make sure to only test the signed extensions that are listed in the test plan item.
It is expected that regular extension install does not work due to this weird setup.

[joyceerhl]

I was able to install all extensions on Windows x64 except nikhgup1.appmap123 due to version mismatch

2022-10-26 10:42:43.908 [error] Failed to install extension. nikhgup1.appmap123
2022-10-26 10:42:43.909 [error] Invalid: Cannot install 'nikhgup1.appmap123' extension because of version mismatch in Marketplace
    at $.checkAndGetCompatibleVersion (vscode-file://vscode-app/c:/Users/huer/AppData/Local/Programs/Microsoft%20VS%20Code%20Insiders/resources/app/out/vs/code/electron-browser/sharedProcess/sharedProcessMain.js:87:96873)
    at async $.installFromGallery (vscode-file://vscode-app/c:/Users/huer/AppData/Local/Programs/Microsoft%20VS%20Code%20Insiders/resources/app/out/vs/code/electron-browser/sharedProcess/sharedProcessMain.js:87:86770)

[sandy081]

Thanks everyone for testing 👏