python3[7,8]Packages.scipy fails to build on master

[drewrisinger]

Describe the bug
python37Packages.scipy build fails on master commit.
3bbd074

To Reproduce
Steps to reproduce the behavior:

1. git checkout 3bbd074217cd11b6e14abec24655091b83aacc6f
2. nix-build -A python37Packages.scipy

Expected behavior
Clean build

Screenshots
Looks like it can't find the lapack/blas libraries using numpy build system.

Additional context
Running nix-bisect currently, will update when get results.
Obviously affects most python packages, due to widespread numpy/scipy dependencies

Notify maintainers
@FRidh
(waiting on nix-bisect to find super-dependency that changed to notify that maintainer)

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.

Maintainer information:

# a list of nixpkgs attributes affected by the problem
attribute: python3.pkgs.scipy
# a list of nixos modules affected by the problem
module:

[veprbl]

It's numpy: https://hydra.nixos.org/build/116949583

[drewrisinger]

Bisected to #83888 merge cdfda4b.

[adegomme]

Just had an issue which may be related when upgrading, numpy fails to build indeed, complaining about blas/lapack missing, while it was working before.

numpy.distutils.system_info.NotFoundError: No lapack/blas resources found.

when looking at the numpy/distutils/site.cfg file there is something odd
[openblas]
include_dirs=/nix/store/3gia15f4i46fvxxr6n4n3jlp8di2rxyw-blas-3/include:/nix/store/qrfg733cck2znlfp7bagrlqsrjxja9bm-lapa
ck-3/include
library_dirs=/nix/store/3gia15f4i46fvxxr6n4n3jlp8di2rxyw-blas-3/lib:/nix/store/qrfg733cck2znlfp7bagrlqsrjxja9bm-lapack-3
/lib

the library_dirs exist, but the include_dirs ones don't exist, there is only a lib folder in both /nix/store/3gia15f4i46fvxxr6n4n3jlp8di2rxyw-blas-3/ and /nix/store/qrfg733cck2znlfp7bagrlqsrjxja9bm-lapa
ck-3/

the corresponding include files seem to be located elsewhere, with include folders available in /nix/store/4qsm27xznwbr5jsr7vrqiisgf1x32m8q-blas-3-dev (cblas.h and another) and /nix/store/spin20lh423dk5xa9wq1jp9mw1ia1775-lapack-3-dev (lapack.h and co)

just my two cents as I have no idea whether this will be useful or not.

Just saw the bisect and the pointed commit seems indeed to touch include_dirs and library_dir, so I leave that here.

[drewrisinger]

I think it's being addressed in #85636 @veprbl @adegomme. Thanks for comments, mostly wanted to figure out what was going on for my own reference b/c I was having trouble building after rebasing off master.
FWIW, rebasing off 3fe18a5 (vs master) should work for anyone who finds this thread.

[drewrisinger]

Just had an issue which may be related when upgrading, numpy fails to build indeed, complaining about blas/lapack missing, while it was working before.

Are you sure that it's numpy failing? I think scipy uses numpy internally for building. I can build numpy (nix-build -A python37Packages.numpy), but not scipy (nix-build -A python37Packages.scipy). My error message for scipy was looking similar to what you were seeing.

[eraserhd]

I'm having a problem with python37Packages.numpy on Darwin that looks like this. Except I bisected it to 1c8aba8 "treewide: use blas and lapack" . I can build the same config fine on NixOS.

git checkout 1c8aba83340be3713f68410d1d273a8b15e7e007
nix-build . -A python37Packages.numpy

• system: "x86_64-darwin"
• host os: Darwin 19.2.0, macOS 10.15.2
• multi-user?: yes
• sandbox: no
• version: nix-env (Nix) 2.3.4
• channels(root): "nixpkgs-20.09pre221715.5f814bf9cc4"
• channels(jfelice): "darwin"
• nixpkgs: /Users/jfelice/src/dotfiles/nixpkgs