toolchain: env var filtering fails with line continued environment variables

[Sur3]

When trying to setup cp2k I get the following error:

% ./install_cp2k_toolchain.sh -j 44 --with-gcc=install --with-openmpi=install --with-fftw=install --with-cmake=install --with-openblas=install --with-libint=install --with-libxc=no --with-scalapack=no --with-cosma=no --with-gsl=install --with-spglib=install --with-hdf5=no --with-sirius=no --with-libxsmm=install
MPI is detected and it appears to be OpenMPI
nvcc not found, disabling CUDA by default
You have chosen to install GCC, therefore MPI libraries will have to be installed too
Compiling with 44 processes.
/home/user/cp2k-8.2.0/tools/toolchain/install/toolchain.env: line 31: warning: setlocale: LC_COLLATE: cannot change locale (C.UTF-8)
/home/user/cp2k-8.2.0/tools/toolchain/install/toolchain.env: line 75: :DO=\E[%dB:LE=\E[%dD:RI=\E[%dC:UP=\E[%dA:bs:bt=\E[Z:\: command not found
ERROR: (./scripts/stage0/install_gcc.sh, line 75) Non-zero exit code detected.

[dev-zero]

can you please post the output of the following commands?

cat /etc/os-release
locale

[dev-zero]

and is this a fresh run of install_cp2k_toolchain.sh (so, no build/ or install/ directory in tools/toolchain/) or did you run it before already?

[Sur3]

Yes it is a fresh run.

% cat /etc/os-release                                                                                                                                                                            
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

% locale                                                                                                                                                                                         
locale: Cannot set LC_ALL to default locale: No such file or directory
LANG=de_DE.utf8
LC_CTYPE="de_DE.utf8"
LC_NUMERIC="de_DE.utf8"
LC_TIME="de_DE.utf8"
LC_COLLATE=C.UTF-8
LC_MONETARY="de_DE.utf8"
LC_MESSAGES="de_DE.utf8"
LC_PAPER="de_DE.utf8"
LC_NAME="de_DE.utf8"
LC_ADDRESS="de_DE.utf8"
LC_TELEPHONE="de_DE.utf8"
LC_MEASUREMENT="de_DE.utf8"
LC_IDENTIFICATION="de_DE.utf8"
LC_ALL=

I suppose the locale warning is probably unrelated to the actual error.

[dev-zero]

can you post the toolchain.env? But you might want to check it first for sensitive content.

[Sur3]

Ok thanks, looking deeper into the toolchain.env I found that an old cp2k-5.2 was still in the PATH variable as it was loaded as module, after removing that it seems to work now. Therefore closing this bug. ^.^

[pmitev]

I had this problem when compiling within screen session.
$TERMCAP value spans over several lines which fails upon cleaning.

export -p

...
declare -x SSH_TTY="/dev/pts/6"
declare -x STY="22092.slurm20868348"
declare -x TERM="screen"
declare -x TERMCAP="SC|screen|VT 100/ANSI X3.64 virtual terminal:\\
        :DO=\\E[%dB:LE=\\E[%dD:RI=\\E[%dC:UP=\\E[%dA:bs:bt=\\E[Z:\\
        :cd=\\E[J:ce=\\E[K:cl=\\E[H\\E[J:cm=\\E[%i%d;%dH:ct=\\E[3g:\\
        :do=^J:nd=\\E[C:pt:rc=\\E8:rs=\\Ec:sc=\\E7:st=\\EH:up=\\EM:\\
        :le=^H:bl=^G:cr=^M:it#8:ho=\\E[H:nw=\\EE:ta=^I:is=\\E)0:\\
        :li#24:co#80:am:xn:xv:LP:sr=\\EM:al=\\E[L:AL=\\E[%dL:\\
        :cs=\\E[%i%d;%dr:dl=\\E[M:DL=\\E[%dM:dc=\\E[P:DC=\\E[%dP:\\
        :im=\\E[4h:ei=\\E[4l:mi:IC=\\E[%d@:ks=\\E[?1h\\E=:\\
        :ke=\\E[?1l\\E>:vi=\\E[?25l:ve=\\E[34h\\E[?25h:vs=\\E[34l:\\
        :ti=\\E[?1049h:te=\\E[?1049l:Km=\\E[M:k0=\\E[10~:k1=\\EOP:\\
        :k2=\\EOQ:k3=\\EOR:k4=\\EOS:k5=\\E[15~:k6=\\E[17~:k7=\\E[18~:\\
        :k8=\\E[19~:k9=\\E[20~:k;=\\E[21~:F1=\\E[23~:F2=\\E[24~:\\
        :kh=\\E[1~:@1=\\E[1~:kH=\\E[4~:@7=\\E[4~:kN=\\E[6~:kP=\\E[5~:\\
        :kI=\\E[2~:kD=\\E[3~:ku=\\EOA:kd=\\EOB:kr=\\EOC:kl=\\EOD:"
declare -x TMPDIR="/scratch/20868348"
...

So, simply unset TERMCAP solves the issue in this situation for me.

[dev-zero]

ok, that explains it: we're filtering env variables (like the TERMCAP) but in our testing those vars did not contain line breaks.

[dev-zero]

Maybe the easiest would be to replace our environment variable filtering by python -c 'import os; print(*(f"export {key}={value}" for key, value in os.environ.items() if key not in ["TERMCAP", ]), sep="\n")'.

Or if we want to stay in the shell, doing in a subshell the following:

unset TERMCAP
unset ...

export -p

[Sur3]

I think I was also using screen before, so this could really be the explanation. :)