Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[openssl] Build failure due to nasm.us being down #32600

Closed
Morph1984 opened this issue Jul 17, 2023 · 33 comments
Closed

[openssl] Build failure due to nasm.us being down #32600

Morph1984 opened this issue Jul 17, 2023 · 33 comments
Assignees
Labels
category:question This issue is a question

Comments

@Morph1984
Copy link

Operating system

Windows

Compiler

MSVC

Steps to reproduce the behavior

`./vcpkg install openssl`

Failure logs

Installing 80/81 openssl:x64-windows...
Building openssl:x64-windows...
-- Installing port from location: D:\a\yuzu\yuzu\externals\vcpkg\buildtrees\versioning_\versions\openssl\dc8edd2b6e1e1552688c29dc46d5cd5c9183804b
-- Downloading https://github.com/openssl/openssl/archive/openssl-3.1.1.tar.gz -> openssl-openssl-openssl-3.1.1.tar.gz...
-- Extracting source D:/a/yuzu/yuzu/externals/vcpkg/downloads/openssl-openssl-openssl-3.1.1.tar.gz
-- Applying patch disable-apps.patch
-- Applying patch disable-install-docs.patch
-- Applying patch script-prefix.patch
-- Applying patch windows/install-layout.patch
-- Applying patch windows/install-pdbs.patch
-- Applying patch unix/android-cc.patch
-- Applying patch unix/move-openssldir.patch
-- Applying patch unix/no-empty-dirs.patch
-- Applying patch unix/no-static-libs-for-shared.patch
-- Using source at D:/a/yuzu/yuzu/externals/vcpkg/buildtrees/openssl/src/nssl-3.1.1-53a8e40f57.clean
-- Downloading https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip -> nasm-2.16.01-win64.zip...
[DEBUG] To include the environment variables in debug output, pass --debug-env
[DEBUG] Trying to load bundleconfig from D:\a\yuzu\yuzu\externals\vcpkg\vcpkg-bundle.json
[DEBUG] Failed to open: D:\a\yuzu\yuzu\externals\vcpkg\vcpkg-bundle.json
[DEBUG] Bundle config: readonly=false, usegitregistry=false, embeddedsha=nullopt, deployment=Git, vsversion=nullopt
[DEBUG] Metrics enabled.
[DEBUG] Feature flag 'binarycaching' unset
[DEBUG] Feature flag 'compilertracking' unset
[DEBUG] Feature flag 'registries' unset
[DEBUG] Feature flag 'versions' unset
Downloading https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip
warning: Download failed -- retrying after 1000ms
warning: Download failed -- retrying after 2000ms
warning: Download failed -- retrying after 4000ms
error: Failed to download from mirror set
error: https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip: WinHttpSendRequest failed with exit code 12002
error: https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip: WinHttpSendRequest failed with exit code 12002
error: https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip: WinHttpSendRequest failed with exit code 12002
error: https://www.nasm.us/pub/nasm/releasebuilds/2.16.01/win64/nasm-2.16.01-win64.zip: WinHttpSendRequest failed with exit code 12002
[DEBUG] D:\a\_work\1\s\src\vcpkg\base\downloads.cpp(962): 
[DEBUG] Time in subprocesses: 0us
[DEBUG] Time in parsing JSON: 15us
[DEBUG] Time in JSON reader: 0us
[DEBUG] Time in filesystem: 1211us
[DEBUG] Time in loading ports: 0us
[DEBUG] Exiting after 1.5 min (91186431us)

CMake Error at scripts/cmake/vcpkg_download_distfile.cmake:32 (message):
      
      Failed to download file with error: 1
      If you are using a proxy, please check your proxy setting. Possible causes are:
      
      1. You are actually using an HTTP proxy, but setting HTTPS_PROXY variable
         to `https://address:port`. This is not correct, because `https://` prefix
         claims the proxy is an HTTPS proxy, while your proxy (v2ray, shadowsocksr
         , etc..) is an HTTP proxy. Try setting `http://address:port` to both
         HTTP_PROXY and HTTPS_PROXY instead.
      
      2. If you are using Windows, vcpkg will automatically use your Windows IE Proxy Settings
         set by your proxy software. See https://github.com/microsoft/vcpkg-tool/pull/77
         The value set by your proxy might be wrong, or have same `https://` prefix issue.
      
      3. Your proxy's remote server is out of service.
      
      If you've tried directly download the link, and believe this is not a temporary
      download server failure, please submit an issue at https://github.com/Microsoft/vcpkg/issues
      to report this upstream download server failure.
      

Call Stack (most recent call first):
  scripts/cmake/vcpkg_download_distfile.cmake:270 (z_vcpkg_download_distfile_show_proxy_and_fail)
  scripts/cmake/vcpkg_find_acquire_program.cmake:172 (vcpkg_download_distfile)
  buildtrees/versioning_/versions/openssl/dc8edd2b6e1e1552688c29dc46d5cd5c9183804b/windows/portfile.cmake:1 (vcpkg_find_acquire_program)
  buildtrees/versioning_/versions/openssl/dc8edd2b6e1e1552688c29dc46d5cd5c9183804b/portfile.cmake:68 (include)
  scripts/ports.cmake:147 (include)


error: building openssl:x64-windows failed with: BUILD_FAILED
Elapsed time to handle openssl:x64-windows: 1.6 min
Please ensure you're using the latest port files with `git pull` and `vcpkg update`.
Then check for known issues at:
    https://github.com/microsoft/vcpkg/issues?q=is%3Aissue+is%3Aopen+in%3Atitle+openssl
You can submit a new issue at:
    https://github.com/microsoft/vcpkg/issues/new?title=[openssl]+Build+error&body=Copy+issue+body+from+D%3A%2Fa%2Fyuzu%2Fyuzu%2Fbuild%2Fvcpkg_installed%2Fvcpkg%2Fissue_body.md
You can also sumbit an issue by running (GitHub cli must be installed):
    gh issue create -R microsoft/vcpkg --title "[openssl] Build failure" --body-file D:/a/yuzu/yuzu/build/vcpkg_installed/vcpkg/issue_body.md
-- Running vcpkg install - failed
CMake Error at externals/vcpkg/scripts/buildsystems/vcpkg.cmake:893 (message):
  vcpkg install failed.  See logs for more information:
  D:\a\yuzu\yuzu\build\vcpkg-manifest-install.log
Call Stack (most recent call first):
  CMakeLists.txt:149 (include)

Additional context

nasm.us is down, and no additional mirrors are provided.

@Morph1984 Morph1984 added the category:port-bug The issue is with a library, which is something the port should already support label Jul 17, 2023
@StarGate-One
Copy link
Contributor

I have a cached copy in my vcpkg/downloads folder, hope this helps, just drop into your vcpkg/downloads folder:
nasm-2.16.01-win64.zip

@jimwang118 jimwang118 self-assigned this Jul 18, 2023
@jimwang118
Copy link
Contributor

The download of nasm-2.16.01-win64.zip failed. Please check the network proxy and check whether there is a firewall or anti-virus software blocking the download.

@jimwang118 jimwang118 added category:question This issue is a question and removed category:port-bug The issue is with a library, which is something the port should already support labels Jul 18, 2023
@xengine-qyt
Copy link

cant open nasm web

@v-mkmiecik
Copy link

Shouldn't there be a mirror in case the main source is down? I can't use a cached copy like StarGate-One suggested since I'm using automation.

@linsmod
Copy link

linsmod commented Jul 18, 2023

I have a cached copy in my vcpkg/downloads folder, hope this helps, just drop into your vcpkg/downloads folder: nasm-2.16.01-win64.zip

it works, thanks~

@jimwang118
Copy link
Contributor

The upstream nasm webpage cannot be accessed, waiting for the upstream website to recover.

@berkayozcan
Copy link

I have a cached copy in my vcpkg/downloads folder, hope this helps, just drop into your vcpkg/downloads folder: nasm-2.16.01-win64.zip

Thanks! It works, but need to fix that

@BillyONeal
Copy link
Member

Shouldn't there be a mirror in case the main source is down?

The vcpkg team doesn't currently operate such mirrors because it involves licensing mess.

@maxseg2021
Copy link

somebody has the mac zip file for this? it is still down.

@pavelzw
Copy link

pavelzw commented Jul 19, 2023

They are up again so this issue can be closed.

@kigawas
Copy link

kigawas commented Jul 19, 2023

I have a cached copy in my vcpkg/downloads folder, hope this helps, just drop into your vcpkg/downloads folder: nasm-2.16.01-win64.zip

Since the website is quite often down, in case someone in the future has the same problem, if you are using GitHub Actions, you have to create a download cache folder beforehand:

      - run: echo "VCPKG_ROOT=$env:VCPKG_INSTALLATION_ROOT" | Out-File -FilePath $env:GITHUB_ENV -Append
      - run: New-Item -ItemType "directory" -Path "C:\vcpkg\downloads" -Force
      - run: Invoke-WebRequest -URI "$env:BASE_URL/$env:FILE_NAME" -OutFile "C:\vcpkg\downloads\$env:FILE_NAME"
        env:
          BASE_URL: https://github.com/microsoft/vcpkg/files/12073957
          FILE_NAME: nasm-2.16.01-win64.zip
      - run: vcpkg install openssl:x64-windows-static-md

You can also add if: runner.os == "Windows" if necessary. The openssl installation takes around 15 minutes currently.

@SethBe
Copy link

SethBe commented Jul 25, 2023

@jimwang118 this issue seems to be back.

@jimwang118
Copy link
Contributor

@jimwang118 this issue seems to be back.

Yes, the upstream website can’t be opened again, so we need to wait for the upstream website to recover.

BewareMyPower added a commit to apache/pulsar-client-cpp that referenced this issue Jul 25, 2023
https://www.nasm.us/ is down so that NASM, which is depended by OpenSSL,
cannot be downloaded.

See
microsoft/vcpkg#32600 (comment)
for the temporary workaround.
@juanmalm
Copy link

This is happening again...

@retifrav
Copy link

again

Something new happened over the past 7 hours?

@0x0ACB
Copy link

0x0ACB commented Jul 25, 2023

Maybe switch over to https://fossies.org/windows/misc/nasm-2.16.01-win64.zip ?

@TheNetos
Copy link

Why not use the mirror?

@blackliner
Copy link

Why not use the mirror?

The content seems to be different

  "2.15.05":
    sha256: "3caf6729c1073bf96629b57cee31eeb54f4f8129b01902c73428836550b30a3f"
    url: "https://www.nasm.us/pub/nasm/releasebuilds/2.15.05/nasm-2.15.05.tar.xz"

becoms

    sha256: "f575c516b5c1c28d5d64efdc26ed52b137ad36bfbd2d855d4782f050ca964245"
    url: "https://github.com/netwide-assembler/nasm/archive/refs/tags/nasm-2.15.05.tar.gz"

@dg0yt
Copy link
Contributor

dg0yt commented Jul 25, 2023

Maybe switch over to https://fossies.org/windows/misc/nasm-2.16.01-win64.zip ?

fossies.org's Terms of Use forbid "regular automated accesses" so AFAIU it cannot be used as part of build recipes or CI.
Cf. https://fossies.org/about.html

Why not use the mirror?

vcpkg fails to download binaries (nasm-2.16.01-win64.zip). The github repo doesn't provide them AFAICS.


MSYS2 has nasm binaries, but these are independent builds.
https://packages.msys2.org/base/mingw-w64-nasm

@TheNetos
Copy link

Why not use the mirror?

The content seems to be different

  "2.15.05":
    sha256: "3caf6729c1073bf96629b57cee31eeb54f4f8129b01902c73428836550b30a3f"
    url: "https://www.nasm.us/pub/nasm/releasebuilds/2.15.05/nasm-2.15.05.tar.xz"

becoms

    sha256: "f575c516b5c1c28d5d64efdc26ed52b137ad36bfbd2d855d4782f050ca964245"
    url: "https://github.com/netwide-assembler/nasm/archive/refs/tags/nasm-2.15.05.tar.gz"

Different algorithms for compressing archives give different hashes, it looks like this

@TheNetos
Copy link

vcpkg fails to download binaries (nasm-2.16.01-win64.zip). The github repo doesn't provide them AFAICS.

Well, by tag nasm-2.16.01 i see only https://github.com/netwide-assembler/nasm/archive/refs/tags/nasm-2.16.01.zip, non-windows-specific version

thats sad

@BillyONeal
Copy link
Member

Anyone have contact info for the nasm.us folks? If they would put the content on github we would love to add mirrors. We have historically not operated our own mirrors because licensing scary, not because we don't think it would be an improvement.

@mc-nv
Copy link

mc-nv commented Jul 26, 2023

I'm keep seeing issue by trying to reach given mirror.

@dg0yt
Copy link
Contributor

dg0yt commented Jul 26, 2023

Anyone have contact info for the nasm.us folks?

Maybe https://lists.nasm.us/nasm-devel/, nasm-devel@nasm.us?

@TheNetos
Copy link

TheNetos commented Jul 26, 2023

nasm.us is available (at the time of writing this comment).

UPD: https://lists.nasm.us certificate expired on July 26th :)

@yisonPylkita
Copy link

Its down again :(
image

@theduckrules
Copy link

I have a cached copy in my vcpkg/downloads folder, hope this helps, just drop into your vcpkg/downloads folder: nasm-2.16.01-win64.zip

Thank you! I was stumped until I read your solution.

@stephengtuggy
Copy link

So https://nasm.us is back up. Their homepage indicates that their source code is already on GitHub, at https://github.com/netwide-assembler/nasm

@StarGate-One
Copy link
Contributor

The source code is, but at this time vcpkg does not build nasm - it just downloads the appropriate pre-built binaries from https://nasm.us...

@jmevel
Copy link

jmevel commented Aug 7, 2023

So https://nasm.us is back up. Their homepage indicates that their source code is already on GitHub, at https://github.com/netwide-assembler/nasm

And....... It's back down again 🙄

@stephengtuggy
Copy link

Is there any compelling reason not to build from source? This is becoming kind of a nuisance.

@StarGate-One
Copy link
Contributor

A mirror was added in commit fe1369a today, so you may need to do a git pull to update scripts/cmake/vcpkg_find_acquire_program(NASM).cmake script.

@jimwang118
Copy link
Contributor

This PR 32806 adds a different nasm download address, update vcpkg to get it if you need it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category:question This issue is a question
Projects
None yet
Development

No branches or pull requests