Packages dsdp, scip_sdp #34749

[scip_sdp-4.1.0] -- Build shared libraries: ON
[scip_sdp-4.1.0] -- Found lapack library: /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk/usr/lib/liblapack.tbd
[scip_sdp-4.1.0] -- Found blas library: /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk/usr/lib/libblas.tbd

needs to be changed so it uses our openblas

[scip_sdp-4.1.0] -- Finding symmetry computation program "bliss"
[scip_sdp-4.1.0] -- Finding BLISS
[scip_sdp-4.1.0] -- Finding BLISS - found
...
[scip_sdp-4.1.0] /Users/mkoeppe/s/sage/sage-rebasing/local/var/tmp/sage/build/scip_sdp-4.1.0/src/src/symmetry/compute_symmetry_bliss.cpp:42:10: fatal error: 'bliss/defs.hh' file not found
[scip_sdp-4.1.0] #include <bliss/defs.hh>
[scip_sdp-4.1.0]          ^~~~~~~~~~~~~~~

needs to be find scip's vendored bliss (or we need to unvendor - #33010/#34747)

Last 10 new commits:

`68fb9a7`	`build/pkgs/scipoptsuite/dependencies: Add papilo`
`2dd029e`	`build/pkgs/{scipoptsuite,soplex}: Use papilo`
`5efb7ba`	`build/pkgs/soplex/dependencies: Add papilo`
`0fc60a0`	`build/pkgs/scipoptsuite: Fix install_name on macOS`
`392455d`	`build/pkgs/scip: Rename from scipoptsuite`
`45f957e`	`Revert "build/pkgs/boost_cropped/distros/debian.txt: Add libboost-program-options-dev"`
`931e348`	`Merge #34726`
`9b40272`	`build/pkgs/scip/distros/conda.txt: New`
`6221180`	`Merge #31329`
`8a954ab`	`build/pkgs/scip_sdp: New`

mkoeppe · 2022-12-06T22:27:28Z

comment:6

The failure with bliss was due to a broken local installation

mkoeppe · 2022-12-06T23:01:48Z

comment:7

scip_sdp should probably use https://cmake.org/cmake/help/latest/module/FindLAPACK.html, https://cmake.org/cmake/help/latest/module/FindBLAS.html

sagetrac-git · 2022-12-06T23:02:29Z

Changed commit from 8a954ab to 8250adb

sagetrac-git · 2022-12-06T23:02:29Z

Branch pushed to git repo; I updated commit sha1. New commits:

`8250adb`	`build/pkgs/scip_sdp/spkg-install.in: Better config`

mkoeppe · 2022-12-06T23:04:10Z

comment:9

Many linker errors on macOS:

[scip_sdp-4.1.0] [100%] Linking CXX shared library ../lib/libscipsdp.dylib
[scip_sdp-4.1.0] cd /Users/mkoeppe/s/sage/sage-rebasing/local/var/tmp/sage/build/scip_sdp-4.1.0/src/build/src && /usr/local/Cellar/cmake/3.24.2/bin/cmake -E cmake_link_script CMakeFiles/libscipsdp.dir/link.txt --verbose=1
[scip_sdp-4.1.0] /Library/Developer/CommandLineTools/usr/bin/g++  -std=gnu++11 -g -O2 -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk -dynamiclib -Wl,-headerpad_max_install_names -L/Users/mkoeppe/s/sage/sage-rebasing/local/lib -Wl,-rpath,/Users/mkoeppe/s/sage/sage-rebasing/local/lib -L/Users/mkoeppe/s/sage/sage-rebasing/local/lib -Wl,-rpath,/Users/mkoeppe/s/sage/sage-rebasing/local/lib -compatibility_version 4.1.0 -current_version 4.1.0 -o ../lib/libscipsdp.4.1.0.dylib -install_name libscipsdp.4.1.dylib CMakeFiles/libscipsdp.dir/scipsdp/SdpVarmapper.c.o CMakeFiles/libscipsdp.dir/scipsdp/SdpVarfixer.c.o CMakeFiles/libscipsdp.dir/scipsdp/cons_sdp.c.o CMakeFiles/libscipsdp.dir/scipsdp/cons_savedsdpsettings.c.o CMakeFiles/libscipsdp.dir/scipsdp/cons_savesdpsol.c.o CMakeFiles/libscipsdp.dir/scipsdp/relax_sdp.c.o CMakeFiles/libscipsdp.dir/scipsdp/disp_sdpiterations.c.o CMakeFiles/libscipsdp.dir/scipsdp/disp_sdpavgiterations.c.o CMakeFiles/libscipsdp.dir/scipsdp/disp_sdpfastsettings.c.o CMakeFiles/libscipsdp.dir/scipsdp/disp_sdppenalty.c.o CMakeFiles/libscipsdp.dir/scipsdp/disp_sdpunsolved.c.o CMakeFiles/libscipsdp.dir/scipsdp/prop_sdpredcost.c.o CMakeFiles/libscipsdp.dir/scipsdp/branch_sdpmostfrac.c.o CMakeFiles/libscipsdp.dir/scipsdp/branch_sdpmostinf.c.o CMakeFiles/libscipsdp.dir/scipsdp/branch_sdpobjective.c.o CMakeFiles/libscipsdp.dir/scipsdp/branch_sdpinfobjective.c.o CMakeFiles/libscipsdp.dir/scipsdp/heur_sdpfracround.c.o CMakeFiles/libscipsdp.dir/scipsdp/heur_sdpinnerlp.c.o CMakeFiles/libscipsdp.dir/scipsdp/heur_sdpfracdiving.c.o CMakeFiles/libscipsdp.dir/scipsdp/heur_sdprand.c.o CMakeFiles/libscipsdp.dir/scipsdp/prop_sdpsymmetry.c.o CMakeFiles/libscipsdp.dir/scipsdp/prop_sdpobbt.c.o CMakeFiles/libscipsdp.dir/scipsdp/prop_companalcent.c.o CMakeFiles/libscipsdp.dir/scipsdp/reader_cbf.c.o CMakeFiles/libscipsdp.dir/scipsdp/reader_sdpa.c.o CMakeFiles/libscipsdp.dir/scipsdp/sdpsymmetry.c.o CMakeFiles/libscipsdp.dir/scipsdp/table_relaxsdp.c.o CMakeFiles/libscipsdp.dir/scipsdp/table_slater.c.o CMakeFiles/libscipsdp.dir/scipsdp/scipsdpdefplugins.c.o CMakeFiles/libscipsdp.dir/sdpi/sdpi.c.o CMakeFiles/libscipsdp.dir/sdpi/sdpsolchecker.c.o CMakeFiles/libscipsdp.dir/sdpi/solveonevarsdp.c.o CMakeFiles/libscipsdp.dir/sdpi/lapack_interface.c.o CMakeFiles/libscipsdp.dir/sdpi/sdpiclock.c.o CMakeFiles/libscipsdp.dir/scipsdpgithash.c.o CMakeFiles/libscipsdp.dir/sdpi/sdpisolver_none.c.o CMakeFiles/libscipsdp.dir/symmetry/compute_symmetry_bliss.cpp.o  /Users/mkoeppe/s/sage/sage-rebasing/local/lib/libbliss.a /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk/usr/lib/liblapack.tbd /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk/usr/lib/libblas.tbd -lm 
...
scip_sdp-4.1.0]   "_SCIPverbMessage", referenced from:
[scip_sdp-4.1.0]       _consLockSdp in cons_sdp.c.o
[scip_sdp-4.1.0]       _consExitSdp in cons_sdp.c.o
[scip_sdp-4.1.0]       _consPresolSdp in cons_sdp.c.o
[scip_sdp-4.1.0]       _relaxInitSolSdp in relax_sdp.c.o
[scip_sdp-4.1.0]       _relaxExitSolSdp in relax_sdp.c.o
[scip_sdp-4.1.0]       _SCIPparamChgdSolvesdps in relax_sdp.c.o
[scip_sdp-4.1.0]       _SCIPrelaxSdpComputeAnalyticCenters in relax_sdp.c.o
[scip_sdp-4.1.0]       ...
[scip_sdp-4.1.0]   "_SCIPwarningMessage", referenced from:
[scip_sdp-4.1.0]       _calcRelax in relax_sdp.c.o
[scip_sdp-4.1.0]       _determineSymmetry in prop_sdpsymmetry.c.o
[scip_sdp-4.1.0]       _readerReadSdpa in reader_sdpa.c.o
[scip_sdp-4.1.0] ld: symbol(s) not found for architecture x86_64
[scip_sdp-4.1.0] clang: error: linker command failed with exit code 1 (use -v to see invocation)
[scip_sdp-4.1.0] make[5]: *** [lib/libscipsdp.4.1.0.dylib] Error 1

Looks like it forgets to link the scip library

mkoeppe · 2022-12-06T23:49:16Z

comment:10

Opened scipopt/SCIP-SDP#1

sagetrac-git · 2022-12-07T23:06:51Z

Branch pushed to git repo; I updated commit sha1. New commits:

`0a5647a`	`build/pkgs/scip_sdp/patches: Add macOS build patches`

sagetrac-git · 2022-12-07T23:06:51Z

Changed commit from 8250adb to 0a5647a

sagetrac-git · 2022-12-09T03:18:44Z

Changed commit from 0a5647a to f90180c

sagetrac-git · 2022-12-09T03:18:44Z

Branch pushed to git repo; I updated commit sha1. New commits:

`f90180c`	`build/pkgs/dsdp: New dummy package`

mkoeppe · 2022-12-09T05:07:31Z

comment:13

https://github.com/cvxopt/cvxopt-wheels/blob/master/library_builders.sh has an install script for dsdp

dimpase · 2022-12-09T09:21:54Z

comment:14

DSDP should be a separate Sage package, I think.

mkoeppe · 2022-12-09T17:45:05Z

comment:15

Yes, but this ancient package has no proper build system. Various ad hoc installation scripts in downstream packages:

https://github.com/macports/macports-ports/tree/master/math/DSDP
https://salsa.debian.org/debian/dsdp/-/blob/debian/master/debian/rules
https://src.fedoraproject.org/rpms/DSDP/blob/rawhide/f/DSDP.Makefile ("Forget it! I'm writing my own Makefile")
https://gitweb.gentoo.org/repo/gentoo.git/tree/sci-libs/dsdp

sagetrac-git · 2022-12-09T18:12:30Z

Changed commit from f90180c to f7e21a0

sagetrac-git · 2022-12-09T18:12:30Z

Branch pushed to git repo; I updated commit sha1. New commits:

`98155a5`	`build/pkgs/dsdp: Add installation script`
`4d02672`	`build/pkgs/dsdp/distros/conda.txt: New`
`f7e21a0`	`build/pkgs/scip_sdp: Use upstream patch https://github.com/scipopt/SCIP-SDP/commit/09e79cf75146ca34c637f919d1f4527a63743300, configure blas/lapack`

sagetrac-git · 2022-12-09T18:14:46Z

Changed commit from f7e21a0 to a90f917

sagetrac-git · 2022-12-09T18:14:46Z

Branch pushed to git repo; I updated commit sha1. New commits:

`a90f917`	`build/pkgs/dsdp/patches/debian-type-mismatch.patch: New`

sagetrac-git · 2022-12-09T18:20:13Z

Branch pushed to git repo; I updated commit sha1. New commits:

`24dae35`	`build/pkgs/dsdp/distros/repology.txt: New`

sagetrac-git · 2022-12-09T23:54:53Z

Branch pushed to git repo; I updated commit sha1. New commits:

`8ef2ea4`	`build/pkgs/scip_sdp/patches/another_blas_change.patch: New`

sagetrac-git · 2022-12-09T23:54:53Z

Changed commit from a10dd81 to 8ef2ea4

mkoeppe · 2022-12-10T01:05:36Z

comment:39

scipopt/SCIP-SDP#5

mkoeppe · 2022-12-10T02:52:09Z

comment:40

archlinux-latest-standard (https://github.com/mkoeppe/SCIP-SDP/actions/runs/3660649526/jobs/6190005686)

  [scip_sdp-git]   /usr/sbin/g++  -std=gnu++11 -g -O2 -Wl,-rpath-link,/sage/local/lib -L/sage/local/lib -Wl,-rpath,/sage/local/lib -Wl,-rpath-link,/sage/local/lib -L/sage/local/lib -Wl,-rpath,/sage/local/lib -rdynamic CMakeFiles/scipsdp.dir/scipsdp/main.c.o CMakeFiles/scipsdp.dir/scipsdp/SdpVarmapper.c.o CMakeFiles/scipsdp.dir/scipsdp/SdpVarfixer.c.o CMakeFiles/scipsdp.dir/scipsdp/cons_sdp.c.o CMakeFiles/scipsdp.dir/scipsdp/cons_savedsdpsettings.c.o CMakeFiles/scipsdp.dir/scipsdp/cons_savesdpsol.c.o CMakeFiles/scipsdp.dir/scipsdp/relax_sdp.c.o CMakeFiles/scipsdp.dir/scipsdp/disp_sdpiterations.c.o CMakeFiles/scipsdp.dir/scipsdp/disp_sdpavgiterations.c.o CMakeFiles/scipsdp.dir/scipsdp/disp_sdpfastsettings.c.o CMakeFiles/scipsdp.dir/scipsdp/disp_sdppenalty.c.o CMakeFiles/scipsdp.dir/scipsdp/disp_sdpunsolved.c.o CMakeFiles/scipsdp.dir/scipsdp/prop_sdpredcost.c.o CMakeFiles/scipsdp.dir/scipsdp/branch_sdpmostfrac.c.o CMakeFiles/scipsdp.dir/scipsdp/branch_sdpmostinf.c.o CMakeFiles/scipsdp.dir/scipsdp/branch_sdpobjective.c.o CMakeFiles/scipsdp.dir/scipsdp/branch_sdpinfobjective.c.o CMakeFiles/scipsdp.dir/scipsdp/heur_sdpfracround.c.o CMakeFiles/scipsdp.dir/scipsdp/heur_sdpinnerlp.c.o CMakeFiles/scipsdp.dir/scipsdp/heur_sdpfracdiving.c.o CMakeFiles/scipsdp.dir/scipsdp/heur_sdprand.c.o CMakeFiles/scipsdp.dir/scipsdp/prop_sdpsymmetry.c.o CMakeFiles/scipsdp.dir/scipsdp/prop_sdpobbt.c.o CMakeFiles/scipsdp.dir/scipsdp/prop_companalcent.c.o CMakeFiles/scipsdp.dir/scipsdp/reader_cbf.c.o CMakeFiles/scipsdp.dir/scipsdp/reader_sdpa.c.o CMakeFiles/scipsdp.dir/scipsdp/sdpsymmetry.c.o CMakeFiles/scipsdp.dir/scipsdp/table_relaxsdp.c.o CMakeFiles/scipsdp.dir/scipsdp/table_slater.c.o CMakeFiles/scipsdp.dir/scipsdp/scipsdpdefplugins.c.o CMakeFiles/scipsdp.dir/sdpi/sdpi.c.o CMakeFiles/scipsdp.dir/sdpi/sdpsolchecker.c.o CMakeFiles/scipsdp.dir/sdpi/solveonevarsdp.c.o CMakeFiles/scipsdp.dir/sdpi/lapack_interface.c.o CMakeFiles/scipsdp.dir/sdpi/sdpiclock.c.o CMakeFiles/scipsdp.dir/scipsdpgithash.c.o CMakeFiles/scipsdp.dir/sdpi/sdpisolver_dsdp.c.o CMakeFiles/scipsdp.dir/symmetry/compute_symmetry_bliss.cpp.o -o ../bin/scipsdp  -ldsdp /sage/local/lib/libscip.so.8.0.2.0 -Wl,-Bstatic -lbliss -Wl,-Bdynamic -llapack -lm 
  [scip_sdp-git]   cd /sage/local/var/tmp/sage/build/scip_sdp-git/src/build/src && /usr/bin/cmake -E cmake_symlink_library ../lib/libscipsdp.so.4.1.0 ../lib/libscipsdp.so.4.1 ../lib/libscipsdp.so
  [scip_sdp-git]   [100%] Built target libscipsdp
  [scip_sdp-git]   /usr/sbin/ld: CMakeFiles/scipsdp.dir/sdpi/lapack_interface.c.o: undefined reference to symbol 'dgemm_'
  [scip_sdp-git]   /usr/sbin/ld: /usr/lib/libopenblas.so.3: error adding symbols: DSO missing from command line
  [scip_sdp-git]   collect2: error: ld returned 1 exit status
  [scip_sdp-git]   make[5]: *** [src/CMakeFiles/scipsdp.dir/build.make:695: bin/scipsdp] Error 1

mkoeppe · 2022-12-10T03:01:52Z

comment:41

The failure on opensuse-tumbleweed-minimal is tracked in #34764.

The failure on centos-stream-9-pyhton3.9-minimal is #34786.

The failure on ubuntu-trusty-... comes from #34726.

The failure on conda-forge will disappear when #33842 is merged.

sagetrac-git · 2022-12-10T03:18:54Z

Changed commit from 8ef2ea4 to b9c9e3d

sagetrac-git · 2022-12-10T03:18:54Z

Branch pushed to git repo; I updated commit sha1. New commits:

`b9c9e3d`	`build/pkgs/scip_sdp/patches/zz_another_blas_change.patch: Link through with blas`

mkoeppe · 2022-12-10T04:33:26Z

comment:43

This has fixed archlinux-latest-standard (comment:40)

mkoeppe · 2022-12-10T04:38:35Z

comment:44

Ready for review

dimpase · 2022-12-11T22:55:31Z

comment:45

lgtm

dimpase · 2022-12-11T22:55:31Z

Changed reviewer from https://github.com/mkoeppe/SCIP-SDP/actions/runs/3660649526 to Dima Pasechnik

mkoeppe · 2022-12-11T23:47:34Z

comment:46

Thank you

mkoeppe · 2023-01-02T21:02:47Z

comment:47

Pdf docs don't build (#31329 comment:49)

sagetrac-git · 2023-01-02T21:11:16Z

Changed commit from b9c9e3d to 544d123

sagetrac-git · 2023-01-02T21:11:16Z

Branch pushed to git repo; I updated commit sha1. New commits:

`d954f18`	`Merge tag '9.8.beta6' into t/34749/package_scip_sdp`
`544d123`	`build/pkgs/scip_sdp/SPKG.rst: Remove bad unicode`

mkoeppe · 2023-01-02T21:53:25Z

comment:49

pdf builds now

vbraun · 2023-01-12T22:12:02Z

Changed branch from u/mkoeppe/package_scip_sdp to 544d123

mkoeppe added this to the sage-9.8 milestone Nov 15, 2022

mkoeppe added c: packages: optional labels Nov 15, 2022

This comment has been minimized.

Sign in to view

mkoeppe changed the title ~~Package scipsdp~~ Package scip_sdp Dec 6, 2022

This comment has been minimized.

Sign in to view

mkoeppe added the s: needs work label Dec 9, 2022

mkoeppe added s: needs review and removed s: needs work labels Dec 10, 2022

dimpase added s: positive review and removed s: needs review labels Dec 11, 2022

mkoeppe added s: needs work and removed s: positive review labels Jan 2, 2023

mkoeppe added s: positive review and removed s: needs work labels Jan 2, 2023

vbraun removed the s: positive review label Jan 12, 2023

vbraun closed this as completed in 3d86126 Jan 12, 2023

mkoeppe mentioned this issue Jan 29, 2023

Meta-ticket: Use Python optimization interfaces: CVXPY, SCIP, or-tools, PuLP, Pyomo, cylp... #26511

Open

mkoeppe mentioned this issue Feb 25, 2023

Build cvxopt with dsdp #35202

Open

Packages dsdp, scip_sdp #34749

Packages dsdp, scip_sdp #34749

Comments

mkoeppe commented Nov 15, 2022

This comment has been minimized.

mkoeppe commented Dec 6, 2022

This comment has been minimized.

This comment has been minimized.

mkoeppe commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

sagetrac-git mannequin commented Dec 6, 2022

sagetrac-git mannequin commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

mkoeppe commented Dec 6, 2022

sagetrac-git mannequin commented Dec 7, 2022

sagetrac-git mannequin commented Dec 7, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

mkoeppe commented Dec 9, 2022

dimpase commented Dec 9, 2022

mkoeppe commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

sagetrac-git mannequin commented Dec 9, 2022

mkoeppe commented Dec 10, 2022

mkoeppe commented Dec 10, 2022

mkoeppe commented Dec 10, 2022

sagetrac-git mannequin commented Dec 10, 2022

sagetrac-git mannequin commented Dec 10, 2022

mkoeppe commented Dec 10, 2022

mkoeppe commented Dec 10, 2022

dimpase commented Dec 11, 2022

dimpase commented Dec 11, 2022

mkoeppe commented Dec 11, 2022

mkoeppe commented Jan 2, 2023

sagetrac-git mannequin commented Jan 2, 2023

sagetrac-git mannequin commented Jan 2, 2023

mkoeppe commented Jan 2, 2023

vbraun commented Jan 12, 2023