[staging]: texlive: 2017 -> 2018 #45432

xeji · 2018-08-21T16:39:17Z

Motivation for this change

Get Texlive 2018 out before the end of 2018, and hopefully into 18.09. Close #40232.

Temporarily based on master for easier building and testing. Will rebase on staging when ready.

Current status

All of texlive.bin builds locally on x64_64-linux
packages updated to snapshot as of 2018-08-22,
texlive.combined.scheme-full builds
pdflatex/lualatex tested with some beamer slides and documents, ok so far
The entire toolchain needs a lot of testing - help appreciated!
We need a solution for hosting a stable snapshot of the package sources because official CTAN mirrors are a moving target, not under version control. Possibly IPFS, project-owned servers, ...

cc @bhipple @vcunat @veprbl

dotlambda · 2018-08-21T21:30:57Z

pkgs/tools/typesetting/tex/texlive/bin.nix

+         name = "texlive-poppler-0.64.patch";
+         url = https://git.archlinux.org/svntogit/packages.git/plain/trunk/texlive-poppler-0.64.patch?h=packages/texlive-bin;
+         sha256 = "0443d074zl3c5raba8jyhavish706arjcd80ibb84zwnwck4ai0w";
+       })


Why did you add the extra whitespace?

That wasn't intentional, maybe my editor's autoindent. Will clean it up before this is merged.

dtzWill · 2018-08-22T00:37:13Z

Hmm, tried building a collection of papers and slides and ran into this:

fixed-output derivation produced path '/nix/store/jjmbfglqfz0xlz96dphvi3as4k7i6dfb-ESIEEcv.tar.xz' with sha512 hash '11b0d4anf4r3xawpdcw89v2xf6b91qkmra9z4nhv26p49ra9pqwgnmviksz92dwhyhg6sd9slcsqq2h1hapk51z5548apj9lyf8grvs' instead of the expected hash '0qlm8xnxxpmr3lbbw0jxqsxs5k8n057d10vx2zj0rm8gw43vg0r2np8rm4ah2wx979v52jip4kp4pi6qjglfdrpq88psclirb1dlxkl'
fixed-output derivation produced path '/nix/store/vrch5hq89igspipan0hmf8vgb7ca3zmf-a5comb.tar.xz' with sha512 hash '347chqnshq7vz89nypaa27b6l9g071rgmc50l9f914hdg4fbw3nhyg7v51rndadl322crgvfjd22wpv38p6yc7gywg7cf6ifb2kwm7c' instead of the expected hash '3yicpqj0jicsxp8i0macyjwjmq4l64rwg0saqcj6sbdpvvrps088hmagd6rk1j68rmfp17366bxx6z0d1b3wamb9yi1hsyk3dybndv9'

(but only after pulling down many many packages first)

I seem to recall hashes change "quickly" (mentioned somewhere in these expressions)--is that what's going on here, or a missed hash? (or? hehe).

Thanks for working on this, I can at least help test a bit! ^_^

dtzWill · 2018-08-22T00:39:04Z

These packages are being grabbed from the 2017 mirror, I think we need a new one?

xeji · 2018-08-22T00:39:05Z

@dtzWill it doesn't work yet because I haven't pushed the update for the package download URLs yet

dtzWill · 2018-08-22T00:40:29Z

@dtzWill it doesn't work yet because I haven't pushed the update for the package download URLs yet

Oh, okay! In that case I guess I'd like to report everything is working as expected! ;)

LMK when some testing would be useful, sorry for the noise!

xeji · 2018-08-22T00:43:16Z

... just pushed the missing commit. texlive.combined.scheme-full builds with this and I tested it with some of my beamer slides and papers, seems to work so far. So now would be the perfect time for some testing 😄 (while I go to sleep)

bhipple · 2018-08-22T02:47:29Z

pkgs/tools/typesetting/tex/texlive/bin.nix

@@ -24,15 +24,15 @@ let
      # FIXME: a proper mirror, though tarballs.nixos.org saves this case ATM


IIRC tarballs.nixos.org does not add everything automatically to the content-address source store; a maintainer has to run this:
https://github.com/NixOS/nixpkgs/blob/master/maintainers/scripts/copy-tarballs.pl

Finding broken/moved tarballs should be easier now, because we're using upstream's sha512 hashes as published on CTAN instead of adding the layer of indirection to download -> verify -> re-hash with sha1; but nevertheless it'd be nice to have the ability to fetch the missing source tarballs from Hydra!

IIRC the script doesn't work on texlive, because we don't use pure fetching (we unpack, modify a bit, and fix hash of the result).

The sources for the binary in this file (bin.nix) should be ok, they are archived by release date and should be stable enough.

The issue is with the thousands of package source tarballs (see default.nix), which are not under version control. For packages, the upstream package database file and our generated pkgs.nix now both use unmodified sha512 hashes of the downloaded .tar.xz files - so maybe uploading them to tarballs.nixos.org could work now?

bhipple · 2018-08-22T03:16:39Z

Thanks for carrying the torch on this one @xeji!

I'm having some issues compiling texlive.bin, though. Are you building with the sandboxes?

In file included from ../../../texk/web2c/luatexdir/luasocket/src/auxiliar.c:8:0:
../../../texk/web2c/luatexdir/luasocket/src/auxiliar.h:32:10: fatal error: lua.h: No such file or directory
 #include "lua.h"
          ^~~~~~~
compilation terminated.
make[2]: *** [Makefile:7258: luatexdir/luasocket/src/liblua53socket_a-auxiliar.o] Error 1
make[2]: Leaving directory '/build/texlive-20180414-source/WorkDir/texk/web2c'

IIRC this one isn't too big for the bot to build (plus everyone should be asleep now anyways). Let's see:

@GrahamcOfBorg build texlive.bin

EDIT: Hmm, I guess it's just something on my computer then . . .

GrahamcOfBorg · 2018-08-22T03:34:56Z

Success on x86_64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

shrinking /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/tex2xindy
gzipping man pages under /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/man/
/nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip is /nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip
stripping (with command /nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip and flags -S) in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/lib  /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin
patching script interpreter paths in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/texmf-dist/scripts/xindy/xindy.pl: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/texmf-dist/scripts/xindy/texindy.pl: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/texindy: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/xindy: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
checking for references to /build in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018...

GrahamcOfBorg · 2018-08-22T03:36:51Z

Success on x86_64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

shrinking /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/tex2xindy
gzipping man pages under /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/man/
/nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip is /nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip
stripping (with command /nix/store/vp40my263xk32f07788srrgl59rycsna-binutils-2.30/bin/strip and flags -S) in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/lib  /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin
patching script interpreter paths in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/texindy: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/bin/xindy: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/texmf-dist/scripts/xindy/xindy.pl: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018/share/texmf-dist/scripts/xindy/texindy.pl: interpreter directive changed from "/usr/bin/env perl" to "/nix/store/4z4iw3x8vr8n23hcifnsl0srhrk9p76x-perl-5.28.0/bin/perl"
checking for references to /build in /nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018...

GrahamcOfBorg · 2018-08-22T03:38:09Z

Success on x86_64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

/nix/store/jy9fbwmasn64kfj7n5x1yvankcp30gpd-texlive-bin-2018
/nix/store/8lb72faq9g0f3za3jsgb93aasi8bkxgw-texlive-core-big.bin-2018
/nix/store/pfx0dpwgjaj8ljaf47q0i26132ig7q3g-texlive-dvipng.bin-2018
/nix/store/jnyj75npb5snkb11m2hlv2rxg1557s9a-texlive-dvisvgm.bin-2018
/nix/store/66y1rbjra8v8gymfpa6ijlbq3jhi8536-texlive-core-big.bin-2018-luatex
/nix/store/dlffli0cif5nw3ifas1cfg2dc7a3pw9s-texlive-core-big.bin-2018-metafont
/nix/store/p2sh3qlz2miziggd26jalwjdijsv0xql-texlive-core-big.bin-2018-metapost
/nix/store/pf28zvprcaw9wwskagkhq9z9i5xlv6fv-texlive-xdvi.bin-2018
/nix/store/0qqza4x78y36ck143dr37pv2lfcpb2lr-texlive-core-big.bin-2018-xetex
/nix/store/cr9xjxkfgmm7fsznfxapqvwkgz1zmr51-texlive-xindy.bin-2018

GrahamcOfBorg · 2018-08-22T03:41:51Z

Failure on aarch64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

'/nix/store/rp5gg36pfdd1vazzngcprhjnpnxqyq3z-texlive-combined-2018/bin/updmap-sys' -> '/nix/store/krydhhfq7m1jkv1s74fw43jcms9fxdij-texlive-tetex-3.0/scripts/texlive/updmap-sys.sh'
'/nix/store/rp5gg36pfdd1vazzngcprhjnpnxqyq3z-texlive-combined-2018/bin/updmap-user' -> '/nix/store/krydhhfq7m1jkv1s74fw43jcms9fxdij-texlive-tetex-3.0/scripts/texlive/updmap-user.sh'
Wrapping './bin/fmtutil-user' and patching shebang '/bin/sh'
Wrapping './bin/mptopdf' and patching weird perl shebang
Wrapping './bin/pdfatfi' and patching shebang '/usr/bin/env perl'
Wrapping './bin/rungs' and patching shebang '/usr/bin/env texlua'
Wrapping './bin/simpdftex' and patching shebang '/bin/sh'
Wrapping './bin/updmap-user' and patching shebang '/bin/sh'
cannot build derivation '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv': 1 dependencies couldn't be built
error: build of '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv' failed

GrahamcOfBorg · 2018-08-22T03:41:53Z

Failure on aarch64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

../src/spvw_sigsegv.d:79:10: warning: this statement may fall through [-Wimplicit-fallthrough=]
       if (serious)
          ^
../src/spvw_sigsegv.d:82:5: note: here
     default:
     ^~~~~~~
make: *** [Makefile:1374: spvw.o] Error 1
builder for '/nix/store/nbzdanjancdzh7j3bvad5kkxdp2zy57f-clisp-2.49.drv' failed with exit code 2
cannot build derivation '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv': 1 dependencies couldn't be built
error: build of '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv' failed

GrahamcOfBorg · 2018-08-22T03:42:51Z

Failure on aarch64-linux (full log)

Attempted: texlive.bin

Partial log (click to expand)

../src/spvw_sigsegv.d:79:10: warning: this statement may fall through [-Wimplicit-fallthrough=]
       if (serious)
          ^
../src/spvw_sigsegv.d:82:5: note: here
     default:
     ^~~~~~~
make: *** [Makefile:1374: spvw.o] Error 1
builder for '/nix/store/nbzdanjancdzh7j3bvad5kkxdp2zy57f-clisp-2.49.drv' failed with exit code 2
cannot build derivation '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv': 1 dependencies couldn't be built
error: build of '/nix/store/c5g4m6x437qdyngb8x6b5kph7439vllk-texlive-xindy.bin-2018.drv' failed

dotlambda · 2018-08-22T08:48:59Z

A package has already been updated:

$ nix build -f . texlive.combined.scheme-full
fixed-output derivation produced path '/nix/store/fna72gc85agnm30gfsiyqm1vrzf8jj2x-gentombow.tar.xz' with sha512 hash '2p6d5kmqahk6k5bv7rc3qiib74368fybr73m97q5xs4znhfwln2pz4ssz8bf18s1zwfk432qqbj7kfn07m75z8d43ayakxzf1c9x2f5' instead of the expected hash '3v79mfjrdw58dh0k6i4qzyanyagr446nw0ksyjap189vla4jl40fq1kwc2ms1a5g9vh4s2cxcqambvqqcx78l3vn1h3jgdb3v2hpmb6'
cannot build derivation '/nix/store/i718qswzrfl8ycrm69bylncbfqd5f3ll-texlive-gentombow-2018.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/bd94c1rbia4yp26yz0cg4azv3r2hr77n-texlive-combined-full-2018.drv': 1 dependencies couldn't be built
[4 built (1 failed)]
error: build of '/nix/store/bd94c1rbia4yp26yz0cg4azv3r2hr77n-texlive-combined-full-2018.drv' failed

xeji · 2018-08-22T09:39:23Z

@dotlambda the last commit puts my private snapshot mirror first on the URL list, so this should work now. But we still need a good solution for a stable mirror of the package sources...

xeji · 2018-08-22T09:42:33Z

aarch64 failure of texlive.bin is unrelated. xindy reqires clisp, which is broken on aarch64.

But let's see if texlive.bin.core builds on all platforms - this shouldn't take too long:
@GrahamcOfBorg build texlive.bin.core

GrahamcOfBorg · 2018-08-22T09:42:52Z

Success on x86_64-linux (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/jy9fbwmasn64kfj7n5x1yvankcp30gpd-texlive-bin-2018

GrahamcOfBorg · 2018-08-22T09:43:00Z

Success on aarch64-linux (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/vazzk0saflyad91r51ccq8cvdx9pz86s-texlive-bin-2018

GrahamcOfBorg · 2018-08-22T10:00:55Z

Success on x86_64-darwin (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/cef5latex: interpreter directive changed from " /bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/bg5pdflatex: interpreter directive changed from " /bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/cefspdflatex: interpreter directive changed from " /bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/sjislatex: interpreter directive changed from " /bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/mkocp: interpreter directive changed from "/bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/tpic2pdftex: interpreter directive changed from "/bin/sh -" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh -"
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018/bin/mktextfm: interpreter directive changed from "/bin/sh" to "/nix/store/zbhk0jhc9y8hmbcax9nvddbik3rgsary-bash-4.4-p23/bin/sh"
/nix/store/5im29qx9rni3w8l3j8i2yr22sin55kxv-cctools-binutils-darwin/bin/strip is /nix/store/5im29qx9rni3w8l3j8i2yr22sin55kxv-cctools-binutils-darwin/bin/strip
patching script interpreter paths in /nix/store/wifif85srw6pkkcx9bc0qwlsfkdsd6g8-texlive-bin-2018-doc
/nix/store/30hr83q4przagg5dssq03ajqji4sbi34-texlive-bin-2018

dtzWill · 2018-08-22T13:38:42Z

Suggested commit: dtzWill@f05ce5d

Otherwise our fmtutil invocation doesn't do anything (compare to TL2017 behavior on NixOS).

I'm having some issues compiling texlive.bin, though. Are you building with the sandboxes?

I saw this as well, but when I went to debug it with some prints/changes it went away and now I can't reproduce :(.
EDIT: I mean the lua.h errors, I believe building teckit or so.

xeji · 2018-08-22T13:57:39Z

Great, thanks, will add that later today. fmtutil without effect was present since the latest texlive 2017 update, see discussion in #40826. Cc @timokau -- Sent from my mobile device

timokau · 2018-08-22T14:37:12Z

Great, thanks for looking into that @dtzWill! Will you backport that change to 2017 @xeji? Or just go to 2018 with that fix included?

xeji · 2018-08-22T14:41:12Z

@timokau I am currently checking this patch with both texlive 2017 and 2018. If it works for both it could go into master.

xeji · 2018-08-29T09:22:28Z

Rebased on staging.
I won't make ofborg rebuild everything on staging, it is likely to time out (llvm, mesa,..).
But let's at least try texlive.bin.core which has fewer dependencies as a final check.
@GrahamcOfBorg build texlive.bin.core

GrahamcOfBorg · 2018-08-29T09:41:09Z

Success on x86_64-darwin (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/mktexlsr: interpreter directive changed from "/bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/mktexmf: interpreter directive changed from "/bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/mktexpk: interpreter directive changed from "/bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/mktextfm: interpreter directive changed from "/bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/sjislatex: interpreter directive changed from " /bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/sjispdflatex: interpreter directive changed from " /bin/sh" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh"
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018/bin/tpic2pdftex: interpreter directive changed from "/bin/sh -" to "/nix/store/cblfnvb5rmhd2z231mqasn0brzh1hhv4-bash-4.4-p23/bin/sh -"
strip is /nix/store/df6k4mgdjxciy0f637lryp7c9ln7n1m3-cctools-binutils-darwin/bin/strip
patching script interpreter paths in /nix/store/c64rgss13z976rqgqg16wkdgyh9bm3z9-texlive-bin-2018-doc
/nix/store/iyjwnrrlmxfbvr4b15i07yaxw4xa8wv1-texlive-bin-2018

GrahamcOfBorg · 2018-08-29T09:49:24Z

Success on aarch64-linux (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018/bin/mktextfm: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018/bin/mktexpk: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018/bin/mktexmf: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018/bin/mktexlsr: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018...
shrinking RPATHs of ELF executables and libraries in /nix/store/s15sbk251wc2ihvw9phgywc79z7zmhdn-texlive-bin-2018-doc
strip is /nix/store/y4ymnvgxygpq05h03kyzbj572zmh6zla-binutils-2.30/bin/strip
patching script interpreter paths in /nix/store/s15sbk251wc2ihvw9phgywc79z7zmhdn-texlive-bin-2018-doc
checking for references to /build in /nix/store/s15sbk251wc2ihvw9phgywc79z7zmhdn-texlive-bin-2018-doc...
/nix/store/82f634c37hpbykbpyd1vvaqqdc06sj9g-texlive-bin-2018

GrahamcOfBorg · 2018-08-29T09:58:29Z

Success on x86_64-linux (full log)

Attempted: texlive.bin.core

Partial log (click to expand)

/nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018/bin/ceflatex: interpreter directive changed from " /bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018/bin/cef5latex: interpreter directive changed from " /bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018/bin/cefpdflatex: interpreter directive changed from " /bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018/bin/tpic2pdftex: interpreter directive changed from "/bin/sh -" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh -"
checking for references to /build in /nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018...
shrinking RPATHs of ELF executables and libraries in /nix/store/vdnpkvif9c0snpwzyr2rq4w8jc96zfxn-texlive-bin-2018-doc
strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
patching script interpreter paths in /nix/store/vdnpkvif9c0snpwzyr2rq4w8jc96zfxn-texlive-bin-2018-doc
checking for references to /build in /nix/store/vdnpkvif9c0snpwzyr2rq4w8jc96zfxn-texlive-bin-2018-doc...
/nix/store/mb3400d3iqiajha17lixzv0hb0rnaih3-texlive-bin-2018

xeji · 2018-08-29T10:00:34Z

I think this can be merged now. Thanks everyone for your help.

timokau · 2018-09-15T20:08:15Z

One of the first two commits (poppler_min: 0.61 -> 0.67 or texlive.bin: 20170524 -> 20180414) have broken the zathura build:

builder for '/nix/store/bkp6dvnsi6nx1yy26vzl0w9zxn22jshl-zathura-core-0.4.0.drv' failed with exit code 1; last 10 log lines:
  [30/38] Compiling C object 'zathura@sta/zathura_shortcuts.c.o'.
  [31/38] Compiling C object 'zathura@sta/zathura_synctex.c.o'.
  FAILED: zathura@sta/zathura_synctex.c.o 
  /nix/store/lzh9rcw3rjvbaj7n3z4nzsvcz85k2p2m-gcc-wrapper-7.3.0/bin/cc -Izathura@sta -I. -I.. -I../ -Idata -I/nix/store/f6raam3phafpy23l3gak2mvk8gpvbky3-gtk+3-3.22.30-dev/include/gtk-3.0 -I/nix/store/cmp7yyigd8l4ix52dp3k0d1qqxxj46wj-glib-2.56.0-dev/include/glib-2.0 -I/nix/store/hvsnfbafr9il3h6bwhb3l8dq9p9gp4vi-glib-2.56.0/lib/glib-2.0/include -I/nix/store/7a5n5xavg8rx1yill07gxd5nhwijmgj3-cairo-1.15.12-dev/include/cairo -I/nix/store/ay7h083ivv8dcw7l4x0w1xb85nxjhi55-freetype-2.9-dev/include/freetype2 -I/nix/store/ay7h083ivv8dcw7l4x0w1xb85nxjhi55-freetype-2.9-dev/include -I/nix/store/xglnyfivgr55wx765mc84v3msyb1mw88-pango-1.42.4-dev/include/pango-1.0 -I/nix/store/hczwzzhm6fgb690dl2cgcsh64rg9jkvg-gdk-pixbuf-2.36.12-dev/include/gdk-pixbuf-2.0 -I/nix/store/y5rbsw4xj6kcnhjl9qfc6np32pbrgcsn-atk-2.28.1-dev/include/atk-1.0 -I/nix/store/3rgzymnavvn74jh0c1xgqdr7n77lx686-girara-0.3.0/include -I/nix/store/cmp7yyigd8l4ix52dp3k0d1qqxxj46wj-glib-2.56.0-dev/include/gio-unix-2.0/ -I/nix/store/6d2bmjmzsxw3gy7pgaiisqggab77bygz-sqlite-3.24.0-dev/include -I/nix/store/0g0g7iflpq6qx2h1v8ljasx6hwcpmgd3-texlive-bin-2018/include/synctex -fdiagnostics-color=always -pipe -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -std=c11 -O3 -fPIC -pthread '-DGETTEXT_PACKAGE="zathura"' '-DLOCALEDIR="/nix/store/rz8c1qgz01q7z6p0ba0vb230mpsjpdkf-zathura-core-0.4.0/share/locale"' '-DZATHURA_PLUGINDIR="/nix/store/rz8c1qgz01q7z6p0ba0vb230mpsjpdkf-zathura-core-0.4.0/lib/zathura"' -D_DEFAULT_SOURCE -DWITH_SQLITE -DWITH_SYNCTEX -DWITH_SYNCTEX1 -DWITH_MAGIC -Wall -Wextra -pedantic -Werror=implicit-function-declaration -Werror=vla -fvisibility=hidden  -MD -MQ 'zathura@sta/zathura_synctex.c.o' -MF 'zathura@sta/zathura_synctex.c.o.d' -o 'zathura@sta/zathura_synctex.c.o' -c ../zathura/synctex.c
  In file included from ../zathura/synctex.c:8:0:
  /nix/store/0g0g7iflpq6qx2h1v8ljasx6hwcpmgd3-texlive-bin-2018/include/synctex/synctex_parser.h:53:10: fatal error: synctex_version.h: No such file or directory
   #include "synctex_version.h"
            ^~~~~~~~~~~~~~~~~~~
  compilation terminated.
  ninja: build stopped: subcommand failed.

I can't tell which one because texlive doesn't build with only the first one.

xeji · 2018-09-15T21:00:48Z

@timokau zathura was fixed by #46376 , which is in staging (but not staging-next).

timokau · 2018-09-15T21:50:55Z

Great, sorry for the noise. Just noticed the build failing on 18.09 but I see you already cherry-picked it to staging-18.09 too.

xeji added the 2.status: work-in-progress This PR isn't done label Aug 21, 2018

xeji added this to the 18.09 milestone Aug 21, 2018

GrahamcOfBorg added 10.rebuild-darwin: 501+ 10.rebuild-linux: 501+ labels Aug 21, 2018

dotlambda reviewed Aug 21, 2018

View reviewed changes

bhipple reviewed Aug 22, 2018

View reviewed changes

xeji mentioned this pull request Aug 22, 2018

texlive: 2017 -> 2017-final #40826

Merged

8 tasks

xeji mentioned this pull request Aug 22, 2018

texlive: fix fmtutil invocation, generate all formats #45466

Merged

xeji changed the base branch from master to staging August 29, 2018 09:05

xeji removed the request for review from FRidh August 29, 2018 09:06

xeji changed the title ~~[WIP]: texlive: 2017 -> 2018~~ [staging]: texlive: 2017 -> 2018 Aug 29, 2018

GrahamcOfBorg added 8.has: clean-up 8.has: package (new) This PR adds a new package labels Aug 29, 2018

xeji removed 8.has: clean-up 8.has: package (new) This PR adds a new package labels Aug 29, 2018

xeji removed the 2.status: work-in-progress This PR isn't done label Aug 29, 2018

xeji merged commit d3036af into NixOS:staging Aug 30, 2018

xeji deleted the texlive-2018 branch August 30, 2018 18:42

timokau mentioned this pull request Sep 15, 2018

Staging next #45941

Merged

9 tasks

veprbl added the 6.topic: TeX Issues regarding texlive and TeX in general label Mar 8, 2019

		@@ -24,15 +24,15 @@ let
		# FIXME: a proper mirror, though tarballs.nixos.org saves this case ATM

[staging]: texlive: 2017 -> 2018 #45432

[staging]: texlive: 2017 -> 2018 #45432

Conversation

xeji commented Aug 21, 2018 • edited Loading

Motivation for this change

Current status

dotlambda Aug 21, 2018

Choose a reason for hiding this comment

xeji Aug 21, 2018

Choose a reason for hiding this comment

dtzWill commented Aug 22, 2018

dtzWill commented Aug 22, 2018

xeji commented Aug 22, 2018

dtzWill commented Aug 22, 2018

xeji commented Aug 22, 2018 • edited Loading

bhipple Aug 22, 2018

Choose a reason for hiding this comment

vcunat Aug 22, 2018

Choose a reason for hiding this comment

xeji Aug 22, 2018

Choose a reason for hiding this comment

bhipple commented Aug 22, 2018 • edited Loading

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

dotlambda commented Aug 22, 2018

xeji commented Aug 22, 2018

xeji commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

GrahamcOfBorg commented Aug 22, 2018

dtzWill commented Aug 22, 2018 • edited Loading

xeji commented Aug 22, 2018 via email

timokau commented Aug 22, 2018

xeji commented Aug 22, 2018

xeji commented Aug 29, 2018

GrahamcOfBorg commented Aug 29, 2018

GrahamcOfBorg commented Aug 29, 2018

GrahamcOfBorg commented Aug 29, 2018

xeji commented Aug 29, 2018

timokau commented Sep 15, 2018

xeji commented Sep 15, 2018

timokau commented Sep 15, 2018

xeji commented Aug 21, 2018 •

edited

Loading

xeji commented Aug 22, 2018 •

edited

Loading

bhipple commented Aug 22, 2018 •

edited

Loading

dtzWill commented Aug 22, 2018 •

edited

Loading