build/bin/sage-spkg-info: Format dependencies file; remove redundant "dependencies" sections from SPKG.rst

[mkoeppe]

For most SPKGs, the dependencies file contains more accurate information than what can be found in the "Dependencies" section of SPKG.rst.

We simplify the format of the dependencies file by introducing new files dependencies_optional, dependencies_order_only, dependencies_check.

We extend the sage-spkg-info script so that, by simple heuristic text wrangling, the dependencies file is transformed to more human-readable form. When formatting for rst output for the "spkg" chapter of the reference manual, we format the dependencies as hyperlinks.
Example: https://d385f0db7500bdc8168e6f7f18d76741efa3742b--sagemath-tobias.netlify.app/reference/spkg/cvxopt.html#dependencies

Then we remove the redundant "dependencies" sections from the SPKG.rst files.

Depends on #33601

CC: @jhpalmieri @seblabbe @slel @dimpase @videlec @tobiasdiez

Component: build

Keywords: sd111

Author: Matthias Koeppe

Branch/Commit: c359f6b

Reviewer: Dima Pasechnik

Issue created by migration from https://trac.sagemath.org/ticket/31017

[mkoeppe]

Dependencies: #29655

[mkoeppe]

Description changed:

--- 
+++ 
@@ -1 +1,6 @@
+For most SPKGs, the `dependencies` file contains more accurate information than what can be found in the "Dependencies" section of `SPKG.rst`.
 
+We extend the `sage-spkg-info` script so that, by simple heuristic text wrangling, the `dependencies` file is transformed to more human-readable form. When formatting for rst output for the "spkg" chapter of the reference manual, we format the dependencies as hyperlinks.
+
+Then we remove the redundant "dependencies" sections from the `SPKG.rst` files.
+

[mkoeppe]

comment:3

Simple clean regexp processing like

for a in build/pkgs/*/dependencies; do echo $((for d in $(sed -n '2,$d;/#/d;s/[$][(][-a-z]* [^)]*[)]//g;s/[$|,()]/ /g;s,[^ /]*/[^ ]*,,g;s/findstring//g;s/OPTIONAL_INSTALLED_PACKAGES//;p' $a); do echo $d; done) | sort); done

does the job

[mkoeppe]

comment:4

Setting new milestone based on a cursory review of ticket status, priority, and last modification date.

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

Description changed:

--- 
+++ 
@@ -1,4 +1,6 @@
 For most SPKGs, the `dependencies` file contains more accurate information than what can be found in the "Dependencies" section of `SPKG.rst`.
+
+We simplify the format of the `dependencies` file by introducing new files `dependencies_optional`, `dependencies_order_only`, `dependencies_check`.
 
 We extend the `sage-spkg-info` script so that, by simple heuristic text wrangling, the `dependencies` file is transformed to more human-readable form. When formatting for rst output for the "spkg" chapter of the reference manual, we format the dependencies as hyperlinks.
 

[mkoeppe]

Branch: u/mkoeppe/build_bin_sage_spkg_info__format_dependencies_file__remove_redundant__dependencies__sections_from_spkg_rst

[mkoeppe]

Changed dependencies from #29655 to none

[mkoeppe]

Commit: 9761ef7

[mkoeppe]

New commits:

49ad190	m4/sage_spkg_collect.m4: Read files dependencies_{optional,order_only,check}
d016254	build/pkgs: Split dependencies_optional and dependencies_check out from dependencies
a9eed44	build/bin/sage-spkg-info: Restore message '(none known)' for packages without system package info
23e7a0b	build/bin/sage-spkg-info: Format dependencies
5f67829	build/pkgs/memory_allocator/SPKG.rst: Fix markup
e8c2830	build/pkgs/mathics/SPKG.rst: Fix title
9761ef7	build/bin/sage-spkg-info: Fix rst label

[sagetrac-git]

Changed commit from 9761ef7 to 5b2ed40

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

5b2ed40

build/pkgs/[a-f]*/SPKG.rst: Remove redundant Dependencies sections; incidental cleanup

[sagetrac-git]

Changed commit from 5b2ed40 to f9e76d5

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

f9e76d5

build/pkgs/*/dependencies: Remove outdated boilerplate comment

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

643fa51

src/doc/en/developer/packaging.rst: Update