Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to download sources from dereferenced.org #302

Closed
jcar87 opened this issue Jun 30, 2023 · 17 comments
Closed

Unable to download sources from dereferenced.org #302

jcar87 opened this issue Jun 30, 2023 · 17 comments

Comments

@jcar87
Copy link

jcar87 commented Jun 30, 2023

It looks like the server the webserver that serves the source distributions for pkgconf is no longer working, e.g. https://distfiles.dereferenced.org/pkgconf/pkgconf-1.9.3.tar.xz is simply timing out.

This causes problems for package repositories where the canonical sources are expected in this location. Sources from GitHub could be an alternative, however I imagine autoreconf needs to be invoked ahead of calling the configure script, so the contents are not exactly the same. Additionally, there's been issues in the past with GitHub archives not being SHA-stable (even if the contents are), which is a requirement for package repositories.

Any updates on this would be appreciated - or if the original files for the source distributions (with the original contents) could be uploaded as GitHub release artifacts (I believe those are guaranteed to be immutable in terms of hash).

@danyeaw
Copy link

danyeaw commented Jul 1, 2023

Could we either use GitHub Releases to post official releases, or is distfiles.dereferenced.org mirrored somewhere? All build systems that depend on downloading pkgconf are down right now.

@cygauss
Copy link

cygauss commented Jul 1, 2023

Google searched out only 2 irrelevant results about distfiles.dereferenced.org in the last 7days. It is amazing that few people find it disappeared, like it never exists.

@MunyDev
Copy link

MunyDev commented Jul 1, 2023

Any updates? Buildroot does not work because the mirror is down.

@kxtzownsu
Copy link

I don't know if the mirror is coming back..
image

@kxtzownsu
Copy link

I've found a solution: archive.org

The latest pkgconf backup is 1.7.4

https://web.archive.org/web/20221108000606/https://distfiles.dereferenced.org/pkgconf/pkgconf-1.7.4.tar.xz

@danyeaw
Copy link

danyeaw commented Jul 1, 2023

I have mirrored the latest release here: https://github.com/wingtk/gvsbuild/releases/download/pkgconf-1.9.5/pkgconf-1.9.5.tar.gz. I think you could also use a gentoo mirror as well: https://gentoo.osuosl.org/distfiles/pkgconf-1.9.5.tar.xz

@kxtzownsu
Copy link

kxtzownsu commented Jul 1, 2023

All the archives are listed here

Manual Link:
https://web.archive.org/web/*/https://distfiles.dereferenced.org/pkgconf* (Edit: Including the * at the end)

@MunyDev
Copy link

MunyDev commented Jul 1, 2023

I have mirrored the latest release here: https://github.com/wingtk/gvsbuild/releases/download/pkgconf-1.9.5/pkgconf-1.9.5.tar.gz. I think you could also use a gentoo mirror as well: https://gentoo.osuosl.org/distfiles/pkgconf-1.9.5.tar.xz

Do you have access to 1.6.5, I need pkgconf 1.6.5 to run buildroot.

@MunyDev
Copy link

MunyDev commented Jul 1, 2023

Is there any way to generate the archives, the same one as in the mirror?

@kumorig
Copy link

kumorig commented Jul 1, 2023

Since I got here because gvsbuild build gtk4 breaks because of this, I just have to ask, why does the script fail to verify checksum?

https://github.com/pkgconf/pkgconf/archive/refs/tags/pkgconf-1.9.5.tar.gz
3fd0ace7d4398d75f0c566759f9beb4f8b3984fee7ed9804d41c52b193d9745a
https://distfiles.dereferenced.org/pkgconf/pkgconf-1.9.5.tar.gz
6466efd2e38c4c0ac5de4e345f0dc6dad57e689efb08c31f2a71547683d20dc7

should we just assume foul play here? :p

@danyeaw
Copy link

danyeaw commented Jul 1, 2023

@kumorig This blog post explains the issue: https://github.blog/2023-02-21-update-on-the-future-stability-of-source-code-archives-and-hashes/

@jcar87
Copy link
Author

jcar87 commented Jul 1, 2023

@kumorig - there's also a chance that the tar.gz have different contents - the ones that are a git snapshot may not contain the ./configure script and you need to call autoreconf to generate it, whereas the "source distribution" files hosted on the website do. This is a very typical scenario

@danyeaw
Copy link

danyeaw commented Jul 2, 2023

It sounds like @kaniini lost access to the domain, so we'll all need to be patient while they resolve it:
https://social.treehouse.systems/@ariadne/110643909699308207

If you want to unleash us to all to contact Dynadot, let us know.

@danyeaw
Copy link

danyeaw commented Jul 2, 2023

It looks like we have a new location: 437c2a3

https://distfiles.ariadne.space/pkgconf/

@rossburton
Copy link

rossburton commented Jul 3, 2023

I endorse also uploading the generated tarballs as release artefacts (note I am not talking about the "source code" link which has the issues discussed above).

arnout pushed a commit to buildroot/buildroot that referenced this issue Jul 3, 2023
Due to problems with the registrar (dynadot) [1], the dereferenced.org
domain got stolen and is up for auction. While sorting that out, the
official download site has changed to a different domain [2]. Update
PKGCONF_SITE to the new location.

There's an upstream bug to track the issue [3].

[1] https://social.treehouse.systems/@ariadne/110643909699308207
[2] pkgconf/pkgconf@437c2a3
[3] pkgconf/pkgconf#302

Fixes: https://bugs.busybox.net/show_bug.cgi?id=15673

Signed-off-by: Sébastien Szymanski <sebastien.szymanski@armadeus.com>
Signed-off-by: Arnout Vandecappelle <arnout@mind.be>
@dheater
Copy link

dheater commented Jul 3, 2023

I was in the process of updating the recipe for Conan, but I am still getting SSL cert at https://distfiles.ariadne.space/pkgconf/

Recommendations?

@kxtzownsu
Copy link

I was in the process of updating the recipe for Conan, but I am still getting SSL cert at https://distfiles.ariadne.space/pkgconf/

That's odd... SSL cert seems fine.

LeSpocky pushed a commit to LeSpocky/ptxdist that referenced this issue Jul 5, 2023
See: pkgconf/pkgconf#302 (comment)

Signed-off-by: Michael Olbrich <m.olbrich@pengutronix.de>
arnout pushed a commit to buildroot/buildroot that referenced this issue Jul 16, 2023
Due to problems with the registrar (dynadot) [1], the dereferenced.org
domain got stolen and is up for auction. While sorting that out, the
official download site has changed to a different domain [2]. Update
PKGCONF_SITE to the new location.

There's an upstream bug to track the issue [3].

[1] https://social.treehouse.systems/@ariadne/110643909699308207
[2] pkgconf/pkgconf@437c2a3
[3] pkgconf/pkgconf#302

Fixes: https://bugs.busybox.net/show_bug.cgi?id=15673

Signed-off-by: Sébastien Szymanski <sebastien.szymanski@armadeus.com>
Signed-off-by: Arnout Vandecappelle <arnout@mind.be>
(cherry picked from commit ef95ec9)
Signed-off-by: Peter Korsgaard <peter@korsgaard.com>
arnout pushed a commit to buildroot/buildroot that referenced this issue Jul 16, 2023
Due to problems with the registrar (dynadot) [1], the dereferenced.org
domain got stolen and is up for auction. While sorting that out, the
official download site has changed to a different domain [2]. Update
PKGCONF_SITE to the new location.

There's an upstream bug to track the issue [3].

[1] https://social.treehouse.systems/@ariadne/110643909699308207
[2] pkgconf/pkgconf@437c2a3
[3] pkgconf/pkgconf#302

Fixes: https://bugs.busybox.net/show_bug.cgi?id=15673

Signed-off-by: Sébastien Szymanski <sebastien.szymanski@armadeus.com>
Signed-off-by: Arnout Vandecappelle <arnout@mind.be>
(cherry picked from commit ef95ec9)
Signed-off-by: Peter Korsgaard <peter@korsgaard.com>
github-merge-queue bot pushed a commit to Homebrew/homebrew-core that referenced this issue Jul 27, 2023
dereferenced.org was recently highjacked, so we probably don't want to
download sources from there.

See:
- pkgconf/pkgconf#302
- pkgconf/pkgconf@437c2a3

Also, add a `head` spec and update the homepage. The existing homepage
looks like it hasn't been touched in a while.
@kaniini kaniini closed this as completed Aug 4, 2023
citral23 pushed a commit to citral23/buildroot that referenced this issue Sep 18, 2023
Due to problems with the registrar (dynadot) [1], the dereferenced.org
domain got stolen and is up for auction. While sorting that out, the
official download site has changed to a different domain [2]. Update
PKGCONF_SITE to the new location.

There's an upstream bug to track the issue [3].

[1] https://social.treehouse.systems/@ariadne/110643909699308207
[2] pkgconf/pkgconf@437c2a3
[3] pkgconf/pkgconf#302

Fixes: https://bugs.busybox.net/show_bug.cgi?id=15673

Signed-off-by: Sébastien Szymanski <sebastien.szymanski@armadeus.com>
Signed-off-by: Arnout Vandecappelle <arnout@mind.be>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants