Support zstd for extraction

[trajano]

Msys2 repo uses zstd for their new packages, can you add support for zstd decompression?

[Calinou]

Scoop depends on 7-zip to extract formats other than ZIP, but the official 7-zip distribution doesn't support Zstandard. Many third-party forks do, though.

[r15ch13]

Scoop can use 7zip-zstd.

scoop bucket add versions
scoop install 7zip-zstd
scoop uninstall 7zip

https://github.com/lukesampson/scoop/blob/96de9c14bb483f9278e4b0a9e22b1923ee752901/lib/core.ps1#L252-L258

[Augiiz]

Still no luck extracting zst packages upon installation, they just sit there.

[r15ch13]

Do you have some example files?

[Augiiz]

Since main buckets gcc still on 9.3 trying to set up my own bucket for gcc 10, but mingw moved some of their archives to zst starting gcc 10.

My bucket: https://github.com/Augiiz/scoop-gcc/blob/master/gcc-a.json

[niheaven]

Need some manual tweaks:

1. Add zst to L19 of lib/decompress.ps1 of scoop (%SCOOP%/apps/scoop/current/lib/decompress.ps1)
2. scoop reset 7zip-zstd
3. Install your gcc10

[Augiiz]

Did it for me, thanks a bunch.

[trajano]

Scoop depends on 7-zip to extract formats other than ZIP, but the official 7-zip distribution doesn't support Zstandard. Many third-party forks do, though.

Is there a PR on the 7Zip mainline to integrate it?

[Calinou]

@trajano I think there have been several, but none of them was merged so far: https://sourceforge.net/p/sevenzip/discussion/45797/thread/a7e4f3f3/

[trajano]

@Calinou from the discussions you linked it seems that there's no further work on integrating it and it had started in 2016. Maybe scoop should consider an alternative to 7z or at least use the official distribution to do the decompression at least it would decouple scoop from 7zip in case there are new compression formats that it does not support.

[wstein]

msys2 has purged many older file version.
Now many packages of msys2 are only available as zstd compressed files.

If this issue will not be fixed, the msys2 based packages like gcc and openssh should be dropped.

[psydvl]

There are also zstd package in main bucket
Why not use only it?
https://github.com/ScoopInstaller/Main/blob/master/bucket/zstd.json

[rashil2000]

This is a pretty important blocker right now.

@niheaven Since you are somewhat familiar with Scoop's internals, can you have a look at which one of these is more appropriate - #4137 or #4372?

[rasa]

Imo, #4372 is probably more appropriate, as it appears to borrow heavily from https://github.com/Ash258/Scoop-Core/pull/97/files .