New Build/Packaging System

[vbraun]

Our current build/packaging system is at the limits of what one can do just with a Makefile and shell scripts. This ticket aims to implement a new system

• Git-aware: use SHA1 hashes instead of timestamps for dependency calculations
• Unified machine-readable package configuration using YAML
• Dependency handling also for optional packages
• Distinction between different types of dependencies: build time, runtime hard/soft, testing.
• Modular, allowing for easy experimentation with per-package backends
• written in pure Python without any dependencies
• doctested for Python 2.6, 2.7, 3.3, and 3.4.

The entire package configuration will be in a file SAGE_ROOT/build/pkgs/<name>/package.yaml, for example

name:
    matplotlib

category:
    standard

source:
    version:  
        1.3.1
    tarball:
        name:     matplotlib-{source.version}.tar.gz
        sha1:     f340378c43c4c3f6219ef9fd84af4ebbe18f8feb

builder:
    type:            SpkgInstallScript
    install_script:  spkg-install

depends:
    build:
        - pkgconf
        - setuptools
    hard:
        - python
        - numpy
        - freetype
        - libpng
        - gdmodule
        - dateutil
        - pyparsing

Component: build

Author: Volker Braun

Branch/Commit: u/vbraun/buildsystem @ 145ebed

Reviewer: Michael Orlitzky

Issue created by migration from https://trac.sagemath.org/ticket/16483

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

f23fa75

add the sage_c_library package

[sagetrac-git]

Changed commit from 6000c99 to f23fa75

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

f3438e5	build -> compile
bc71b57	add sage_python_library and sage_noarch packages

[sagetrac-git]

Changed commit from f23fa75 to bc71b57

[sagetrac-git]

Changed commit from bc71b57 to 6c582be

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

e94c3c9	fix zn_poly typo
6c582be	proper gitignore support

[sagetrac-git]

Changed commit from 6c582be to 145ebed

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

78418ad	fix doctest
0ce7585	working on clean build
1f0eeeb	switch the install metadata directory
145ebed	towards a successful build

[mkoeppe]

comment:6

outdated, should close

[orlitzky]

Reviewer: Michael Orlitzky