stack-to-nix: .. commitAndReleaseBuffer: invalid argument (invalid character) Error

[kamoii]

When trying to generate pkgs.nix with stack-to-nix for repsitory https://github.com/kamoii/websockets/tree/handle-async-exception gives following error:

$ stack-to-nix --output . --stack-yaml stack.yaml
stack-to-nix: ./websockets.nix: commitAndReleaseBuffer: invalid argument (invalid character)

stack-to-nix ver: 49343bf

[angerman]

Hi @kamoii thanks for the bug report, I've tried this against stack-to-nix from 3fc9b09ae4628310375644c48890a1660e68d5d9, and do not get that issue. however, this looks like a utf-8 bug in GHC. Could you provide the ghc version you are using? The generated web sockets.nix will contain:

      copyright = "(c) 2010-2011 Siniša Biđin\n(c) 2011-2018 Jasper Van der Jeugt\n(c) 2011 Steffen Schuldenzucker\n(c) 2011 Alex Lang";

at a first glance which could be the source of the issue you encounter.

[kamoii]

Thanks for your reply!

By ghc version, do you mean globaly installed ghc version? Or ghc version that builded stack-to-nix?

I'm not sure how globaly installed ghc is related. Anyway, here is the version:

$ ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.6.5

I installed it using ghcup.

I used nix to install stack-to-nix so I don't know which ghc version was used to build stack-to-nix.

If its an utf8 issue, maybe LANG env might related? My LANG is ja_JP.UTF-8, though changing it to C didn't change the result.

[kamoii]

Was able to build stack-to-nix directly from nix-tools repository using cabal(needed to specify these package upper limit because of this issue). Now it succesfully generates websockets.nix, pkgs.nix and default.nix.
So I'm assuming there is a problem how I builded/insatlled stack-to-nix using nix. I followed instruction written here.

$ nix build -f https://github.com/input-output-hk/haskell.nix/archive/master.tar.gz nix-tools --out-link nt
$ nix-env -i ./nt

My understanding is that ghc version which is used is determined by nix expression, so I have no clue whats wrong.

EDIT: I'm using nix on Arch linux. Maybe this is causing something wired.

[angerman]

I've just fixed a lot of this quite recently. If LANG=xx_XX.UTF-8 and LC_ALL is set, this works. If however LANG is set but LC_ALL is not, or can not be set, this will fail. I consider this a systems issue not a nix-tools issue I'm afraid. There is little nix-tools could do here :(

[hasufell]

I have the same issue in cardano-wallet: https://github.com/input-output-hk/cardano-wallet/blob/master/nix/regenerate.sh

$ nix/regenerate.sh                                                                                                                                   Mon 14:24
/nix/store/hrpvwkjz04s9i4nmli843hyw9z4pwhww-bash-4.4-p23/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/nix/store/cc39xs797d2h8g865dda28982dz2lwg7-nix-tools-regenerate: line 17: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/nix/store/hrpvwkjz04s9i4nmli843hyw9z4pwhww-bash-4.4-p23/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
stack-to-nix: .stack-to-nix.tmp/.stack.nix/cardano-wallet-jormungandr.nix: commitAndReleaseBuffer: invalid argument (invalid character)

$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=en_US.UTF-8
$ locale -a
C
de_DE.utf8
en_GB.utf8
en_US.utf8
POSIX

[rvl]

@hasufell Are you running on a system without glibc locale files installed? I suspect other programs that you try to run will also report errors such as setlocale: cannot change locale.