plans for packaging on different platforms (package manager integration) #320

benaryorg · 2016-09-01T06:18:05Z

nabijaczleweli · 2016-09-01T09:53:49Z

What about MSYS2 on WIndooze?

benaryorg · 2016-09-01T11:22:14Z

Ah, right, sorry, I had them in mind at the time I started writung but somehow forgot about them.

benaryorg · 2016-09-01T11:25:44Z

Also note that (at least for some people) it would be preferable to really provide both, MSI and simple plain exe/dll builds for Windows.

tomByrer · 2016-09-01T12:42:17Z

I like the idea, but the builder/output repo does not need to be part of this repo. Eg another repo could provide the source for the builder.

tomByrer · 2016-09-01T12:44:39Z

/@benaryorg could you add JavaScript via Enscripten please?

benaryorg · 2016-09-01T12:54:10Z

This would belong to a "port" of the algorithm, I was thinking about the compilation and packaging of the binaries that the code in this repository produces already when running make.

These binaries just need to be wrapped in a deb, rpm, or whatever and uploaded somewhere. This definitely belongs to this repository as the "builder" would be something like travis, buildbot or one of the dozen others that are available, some of them also self-hosted, I don't really know how facebook handles this.

For the *BSD ports or Gentoo parts (actually every source distro/OS) there would probably only be the need to find a (trusted) maintainer.

Cyan4973 · 2016-09-01T14:01:46Z

For debian, there is this package :
https://packages.debian.org/sid/utils/zstd

though I don't know if it means apt-get works out of the box,
need access to relevant VM to test.

These objectives are pretty good,
I just have little idea how to automate them.
If there is an entry point to look at, I'm willing to investigate.

benaryorg · 2016-09-01T14:12:43Z

Well, this repository already uses travis and has a very detailed configuration for that so that could be used to package the files needed. Edit: haven't tried yet but there's AppVeyor for the Windows part.

I haven't ever tried to get something into the official repositories ever and don't have experience with the process so you might want to ask someone who was involved in that. Probably asking in the mailinglists for those OSes and distros could even bring up a maintainer or two.

juanfra684 · 2016-09-02T00:26:11Z

I'm an OpenBSD developer. I'm working on an official package.

benaryorg · 2016-09-02T07:58:53Z

@juanfra684

I'm an OpenBSD developer. I'm working on an official package.

Pkg, ports, or both?

Also, if you finish that package, will that affect the other BSDs?

juanfra684 · 2016-09-02T08:51:14Z

@benaryorg On OpenBSD, the ports are just a tool to build packages.

My work will not affect to other BSDs. Anyway, if zstd works fine on OpenBSD, probably will work also on other BSDs.

intdel · 2016-09-03T21:30:37Z

I tried to email the Debian maintainer for zstd, but he uses a spam@ email address, so I didn't even bother. Not sure what the point is of being a maintainer if one cannot contact you.

pixelb · 2016-09-05T14:00:14Z

Fedora package review at https://bugzilla.redhat.com/1373218

benaryorg · 2016-09-05T15:35:04Z

Added it as WIP.

gyscos · 2016-09-05T19:17:34Z

Archlinux has had a zstd package for a while, if you want to include it.

benaryorg · 2016-09-06T03:12:08Z

I added and checked Arch. Did someone check whether the Debian package works?

Cyan4973 · 2016-09-07T03:12:09Z

A Gentoo package by Patrick Lauer is announced here :
https://packages.gentoo.org/packages/app-arch/zstd

benaryorg · 2016-09-07T07:56:49Z

I can confirm the Gentoo package compiles and runs.

benaryorg · 2016-09-07T07:58:11Z

Can anyone confirm the debian package works and is at least 1.0.0?

intdel · 2016-09-07T17:55:14Z

https://packages.debian.org/search?searchon=names&keywords=zstd

Doesn't look like that there is even one at the moment. If I can find time soon, I'll try to build a debian package.

benaryorg · 2016-09-09T13:54:16Z

Okay so whatever this Debian package is, it's possible to install it but.… well:

$ zstd --version
*** zstd command line interface 64-bits v0.8.0, by Yann Collet ***

Cyan4973 · 2016-09-09T14:16:41Z

Good news is : v0.8.0 is fully compatible with v1.

Anyway, @kdmurray91 seems to be working on next Debian release :
https://qa.debian.org/cgi-bin/vcswatch?package=libzstd

kdm9 · 2016-09-10T01:50:03Z

@benaryorg: As @Cyan4973 says, a Debian package for 1.0.0 is in progress. The package has to make it through the Debian peer review process again, as there are new binary packages and copyright changes.

Please remember that most Debian folks (including myself) are volunteers, and things might not happen instantly 😄.

intdel · 2016-09-10T02:03:10Z

@kdmurray91 I wanted to contact you via email first to get an update etc. (didn't know you are on Github!), but on the Debian package website you provided a spam@whatever email address. Are you actually able to receive email on that address?

kdm9 · 2016-09-10T02:04:07Z

@intdel Yep, I do, thought it gets heavily filtered for spam.

kdm9 · 2016-09-11T04:41:22Z

Just letting you all know that the 1.0.0 package was accepted into Debian Sid. All going well, it will be in testing in a week or so. That means that it will make it into the next stable release of Debian (and Ubuntu and friends).

Cyan4973 · 2016-09-29T10:41:51Z

There seems to be a FreeBSD version, by @jrmarino :
https://github.com/bsd-hacker/freebsd-ports/tree/master/archivers/zstd

benaryorg · 2016-09-29T20:31:31Z

*** zstd command line interface 64-bits v1.0.0, by Yann Collet ***

zstd in FreeBSD seems to be up to date and working.

Edit: no pkg install though.

jrmarino · 2016-09-29T20:36:07Z

On FreeBSD "ports" and "packages" are not separate. All ports that are buildable also have packages generated from those ports (assuming it is legal to distribute them as binary packages).

So there's no port in having two checkboxs. You can do what you did for OpenBSD and put "ports and packages"

by the way, the bullets are messed up. It shows openbsd under freebsd right now.

benaryorg · 2016-09-29T22:10:45Z

@jrmarino Thanks for the heads up.

juanfra684 · 2016-09-30T00:14:24Z

@benaryorg zstd is now an official OpenBSD package. The command to install the package is pkg_add zstd and the unofficial web to browse the packages list is: http://openports.se/archivers/zstd.

jrmarino · 2016-09-30T03:26:52Z

netbsd has had zstd for 2-3 weeks already: http://pkgsrc.se/archivers/zstd

jrmarino · 2016-09-30T03:27:56Z

oh, and "FreeBSD" also includes "DragonFly" (meaning they share the same ports system so both of them have zstd)

benaryorg · 2016-09-30T14:11:21Z

Okay, I just added a few links and checked some boxes.

Does anybody have an idea why Ubuntu is so far behind?

Also, is there anybody who know about Windows' status?

jrmarino · 2016-09-30T14:26:50Z

Another "by the way", NetBSD has it through pkgsrc, which means actually many platforms have it, most notably Illumos, but also some Linux distributions use pkgsrc and technically it's an alternative system for FreeBSD, DragonFly and OpenBSD.

here's a list that I hope is up to date: https://www.netbsd.org/docs/pkgsrc/introduction.html#supported-platforms

Note that it's likely that zstd doesn't build on all the available platforms, not until somebody supplies a patch to pkgsrc or upstream

benaryorg · 2016-09-30T14:40:41Z

I see Cygwin there, that might be worth trying to get to work.

Not saying that the others aren't worth too, but Cygwin is already in the "mainstream OSes" list.

Edit: No OS wars or other things here now, please, I know some "outsiders" are incredibly important to the backbone of various things, but I think those people can manage to get it working on their own, as opposed to the regular Windows, OS X and maybe Buntu user. (Sorry to hardcore Buntu people at that point).

jforberg · 2016-10-01T20:12:14Z

I made an Arch Linux package about a year ago when Zstandard was first published and have been maintaining it since. However, it's in the AUR/unsupported section which requires compiling from source. I don't know the process to get it into the supported/binary section as I have no official standing within the Arch project.

Cyan4973 · 2016-10-04T10:45:19Z

Fedora package is approved :
https://admin.fedoraproject.org/pkgdb/package/rpms/zstd/
and updated to v1.1.0 :
https://bodhi.fedoraproject.org/updates/FEDORA-2016-722779c63b

pixelb · 2016-10-05T19:39:53Z

I was asked to add pzstd to the fedora package and was wondering how supported this variant is at present and how long term it might be. I.E. might its functionality be incorporated into the main util at some stage, thus best not making the util widely available?

benaryorg · 2016-10-06T01:55:14Z

Status Report on Thursday 2016-10-06 (UTC, somewhen very early):

All of the currently checked platforms these have 1.1:

Fedora
Gentoo
Arch Linux
FreeBSD&DragonFlyBSD
OpenBSD
NetBSD

Except Debian which is still at 1.0.

Ubuntu is just weird with having a package but being way outdated (0.5 on xenial, 0.8 on yakkety), although Ubuntu usually has newer packages.…

Alpine and SUSE still don't have anything or at least we don't know anything.

Red Hat Enterprise Linux takes packages from Fedora if I got that right?

Nobody on GitHub seems to care for Windows (or maybe just nobody who found this issue).

A lot of people here did nice work, if noone else, at least I am going to appreciate that. Thank you!

jforberg · 2016-10-06T09:01:26Z

The Arch Linux package was moved to the official repositories yesterday.

https://www.archlinux.org/packages/community/x86_64/zstd/

Cyan4973 · 2016-10-16T17:53:59Z

Not sure if it's related :
http://beta.repology.org/package/zstd.html

pixelb · 2016-10-26T19:28:03Z

In the Red Hat section you could say RHEL and CentOS are now available through EPEL.
I.E. you can use the same package link as used for Fedora for a RHEL/CentOS entry

inikep · 2016-12-23T10:48:13Z

Please check Windows as official Windows binaries compiled with MinGW/MSYS2 are available for zstd v0.8.1 and newer:
https://github.com/facebook/zstd/releases

Cyan4973 · 2017-02-06T21:40:14Z

Alpine Linux proposes zstd v1.1.1 :
https://pkgs.alpinelinux.org/packages?name=zstd

Cyan4973 · 2017-02-06T21:48:42Z

Looks like OpenSUSE also has a package now :
https://build.opensuse.org/package/show/Archiving/zstd

benaryorg · 2017-02-13T23:06:39Z

I think this issue can be closed by now.
If a distro (looking at you Debian Stable) gets stuck on an old version an issue should be opened on their issue tracker I think.
After all, the initial "creating a package and finding a maintainer"-task is done.

Anyone disagree?

Cyan4973 · 2017-02-14T19:33:04Z

Sounds fair 👍

rmax · 2017-03-31T04:05:54Z

I'm not sure where to post this and just to let you know, conda-forge has published packages for zstd, for linux and osx , in the near future there will be packages for windows too.

Packages and installation instructions can be found here: https://anaconda.org/conda-forge/zstd

PD: Recipe is here https://github.com/conda-forge/zstd-feedstock
if anybody want to help maintain it just open an issue and let me know!

Cyan4973 · 2017-04-01T00:36:32Z

Great news @rolando !
For information, as I see on https://anaconda.org/conda-forge/zstd : "License: Unspecified"
the license is BSD

rmax · 2017-04-01T05:25:44Z

@Cyan4973 probably the license is a temporary anaconda.org issue. The recipe has the correct license value https://github.com/conda-forge/zstd-feedstock#about-zstd

inikep mentioned this issue Dec 23, 2016

please add zstd package msys2/MSYS2-packages#774

Closed

inikep mentioned this issue Dec 23, 2016

interesting compression algorithms + policy borgbackup/borg#1633

Open

benaryorg closed this as completed Feb 15, 2017

rmax mentioned this issue Mar 31, 2017

Add zstd library recipe conda-forge/staged-recipes#2581

Merged

plans for packaging on different platforms (package manager integration) #320

plans for packaging on different platforms (package manager integration) #320

Comments

benaryorg commented Sep 1, 2016 • edited by Cyan4973 Loading

nabijaczleweli commented Sep 1, 2016 • edited Loading

benaryorg commented Sep 1, 2016

benaryorg commented Sep 1, 2016 • edited Loading

tomByrer commented Sep 1, 2016

tomByrer commented Sep 1, 2016

benaryorg commented Sep 1, 2016 • edited Loading

Cyan4973 commented Sep 1, 2016

benaryorg commented Sep 1, 2016 • edited Loading

juanfra684 commented Sep 2, 2016

benaryorg commented Sep 2, 2016 • edited Loading

juanfra684 commented Sep 2, 2016

intdel commented Sep 3, 2016

pixelb commented Sep 5, 2016

benaryorg commented Sep 5, 2016 • edited Loading

gyscos commented Sep 5, 2016

benaryorg commented Sep 6, 2016

Cyan4973 commented Sep 7, 2016

benaryorg commented Sep 7, 2016

benaryorg commented Sep 7, 2016

intdel commented Sep 7, 2016

benaryorg commented Sep 9, 2016

Cyan4973 commented Sep 9, 2016

kdm9 commented Sep 10, 2016

intdel commented Sep 10, 2016

kdm9 commented Sep 10, 2016

kdm9 commented Sep 11, 2016

Cyan4973 commented Sep 29, 2016

benaryorg commented Sep 29, 2016 • edited Loading

jrmarino commented Sep 29, 2016

benaryorg commented Sep 29, 2016

juanfra684 commented Sep 30, 2016

jrmarino commented Sep 30, 2016

jrmarino commented Sep 30, 2016

benaryorg commented Sep 30, 2016

jrmarino commented Sep 30, 2016 • edited Loading

benaryorg commented Sep 30, 2016 • edited Loading

jforberg commented Oct 1, 2016

Cyan4973 commented Oct 4, 2016

pixelb commented Oct 5, 2016

benaryorg commented Oct 6, 2016

jforberg commented Oct 6, 2016

Cyan4973 commented Oct 16, 2016

pixelb commented Oct 26, 2016

inikep commented Dec 23, 2016 • edited Loading

Cyan4973 commented Feb 6, 2017

Cyan4973 commented Feb 6, 2017

benaryorg commented Feb 13, 2017

Cyan4973 commented Feb 14, 2017

rmax commented Mar 31, 2017 • edited Loading

Cyan4973 commented Apr 1, 2017

rmax commented Apr 1, 2017

benaryorg commented Sep 1, 2016 •

edited by Cyan4973

Loading

nabijaczleweli commented Sep 1, 2016 •

edited

Loading

benaryorg commented Sep 1, 2016 •

edited

Loading

benaryorg commented Sep 1, 2016 •

edited

Loading

benaryorg commented Sep 1, 2016 •

edited

Loading

benaryorg commented Sep 2, 2016 •

edited

Loading

benaryorg commented Sep 5, 2016 •

edited

Loading

benaryorg commented Sep 29, 2016 •

edited

Loading

jrmarino commented Sep 30, 2016 •

edited

Loading

benaryorg commented Sep 30, 2016 •

edited

Loading

inikep commented Dec 23, 2016 •

edited

Loading

rmax commented Mar 31, 2017 •

edited

Loading