bin/gen_static.jl: only serve a subset of packages?

[DilumAluthge]

I'd like to set up a static server, but I only want to host a subset of packages. What would be the best way to accomplish this?

I guess one approach would be for me to make a fork of General, and then delete everything from the fork that I don't want to host. But that will become a real pain to maintain.

I'm wondering if there is an easier approach?

[StefanKarpinski]

The static server here is really only meant as the simplest possible proof of concept implementation for development and testing of the Pkg server. It doesn't fully satisfy the full Pkg storage contract since it doesn't permanently persist things. If you want to develop a more fully featured static Pkg storage server, it's probably best to fork this script into a separate package and add features there. If that's done, I'd be happy to delete this script and use the separate implementation.

[johnnychen94]

This is what I just built using johnnychen94/StorageMirrorServer.jl#1 and it's functioning well. It would be great to get some feedback and suggestions.

using Pkg
Pkg.update()

using StorageServer

# packages under JuliaImages and their dependencies are all included
pkgs = read_packages("General") do pkg
    occursin("JuliaImages", pkg.url)
end

make_tarball("General";
             packages=pkgs)

bash$ du -sh static/
17G	artifact
475M	package
512	registries
130M	registry

The next feature I plan to add is downloading tarballs from an existing upstream storage/pkg server, that is, a mirror function.