Knowledge Sharing: Distros

Todd Rinaldo edited this page Oct 13, 2017 · 8 revisions

Booking

Perl

  • No taint checking
  • No threads
  • No patches to perl that have not been sent upstream
  • 5.18 - @INC backported, hash randomization,
  • site_customize.pl to remove . from @INC
  • Compile with je-malloc (HUGE)
  • RPM managed but painful (1300 CPAN RPMs)
    • System-RPM variant set more stable.
    • Puppet RPM tries to install RPMS one at a time.
    • 30 mins to build 1 RPM
  • Pakket - multiple instances of RPMs
    • RPMS
  • Moving to 5.24 now Then 5.26 later.
    • Plan to be 1 version behind.
$ perl -V
Summary of my perl5 (revision 5 version 18 subversion 2) configuration:
   
  Platform:
    osname=linux, osvers=2.6.32-642.4.2.el6.x86_64, archname=x86_64-linux
    uname='linux package-201.lhr4.prod.booking.com 2.6.32-642.4.2.el6.x86_64 #1 smp tue aug 23 19:58:13 utc 2016 x86_64 x86_64 x86_64 gnulinux '
    config_args='-des -DSILENT_NO_TAINT_SUPPORT -Dprefix=/usr/local/booking-perl/5.18.2 -Uusevendorprefix -Dsiteprefix=/usr/local/booking-perl/5.18.2 -Dinstallprefix=/usr/local/booking-perl/5.18.2 -Dinstallstyle=lib -Darchlib=/usr/local/booking-perl/5.18.2/lib -Dman1dir=/usr/local/booking-perl/5.18.2/man/man1 -Dman3dir=/usr/local/booking-perl/5.18.2/man/man3 -Dprivlib=/usr/local/booking-perl/5.18.2/lib -Dsitearch=/usr/local/booking-perl/5.18.2/site/lib -Dsitebin=/usr/local/booking-perl/5.18.2/site/bin -Dsitelib=/usr/local/booking-perl/5.18.2/site/lib -Dsiteman1dir=/usr/local/booking-perl/5.18.2/site/man/man1 -Dsiteman3dir=/usr/local/booking-perl/5.18.2/site/man/man3 -Dcc=gcc -Dlibpth=/usr/local/booking-perl/5.18.2/lib /usr/lib64  -Dglibpth=/usr/local/booking-perl/5.18.2/lib /usr/lib64  -Dscriptdir=/usr/local/booking-perl/5.18.2/bin -Uinstallusrbinperl -Duseshrplib -Dusesitecustomize -Dldflags=-ljemalloc -UDEBUGGING -Di_db -A prepend:libswanted=pthread '
    hint=recommended, useposix=true, d_sigaction=define
    useithreads=undef, usemultiplicity=undef
    useperlio=define, d_sfio=undef, uselargefiles=define, usesocks=undef
    use64bitint=define, use64bitall=define, uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='gcc', ccflags ='-fno-strict-aliasing -pipe -fstack-protector -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64',
    optimize='-O2',
    cppflags='-fno-strict-aliasing -pipe -fstack-protector -I/usr/local/include'
    ccversion='', gccversion='4.8.5 20150623 (Red Hat 4.8.5-11)', gccosandvers=''
    intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
    ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=8, prototype=define
  Linker and Libraries:
    ld='gcc', ldflags ='-ljemalloc -fstack-protector'
    libpth=/usr/lib64
    libs=-lpthread -lnsl -lgdbm -ldl -lm -lcrypt -lutil -lc -lgdbm_compat
    perllibs=-lpthread -lnsl -ldl -lm -lcrypt -lutil -lc
    libc=, so=so, useshrplib=true, libperl=libperl.so
    gnulibc_version='2.17'
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-rpath,/usr/local/booking-perl/5.18.2/lib/CORE'
    cccdlflags='-fPIC', lddlflags='-shared -O2 -fstack-protector'


Characteristics of this binary (from libperl): 
  Compile-time options: HAS_TIMES PERLIO_LAYERS PERL_DONT_CREATE_GVSV
                        PERL_HASH_FUNC_ONE_AT_A_TIME_HARD PERL_MALLOC_WRAP
                        PERL_PRESERVE_IVUV PERL_SAWAMPERSAND USE_64_BIT_ALL
                        USE_64_BIT_INT USE_LARGE_FILES USE_LOCALE
                        USE_LOCALE_COLLATE USE_LOCALE_CTYPE
                        USE_LOCALE_NUMERIC USE_PERLIO USE_PERL_ATOF
                        USE_SITECUSTOMIZE
  Built under linux
  Compiled at Feb 20 2017 17:08:45
  %ENV:
    PERL5LIB="/usr/local/git_tree/main/lib"
  @INC:
    /usr/local/git_tree/main/lib
    /usr/local/booking-perl/5.18.2/site/lib
    /usr/local/booking-perl/5.18.2/lib

cPanel

  • started perl 5.6 dependency on B::C
  • B::C working on 5.14 then stopped there for a while
  • current version 5.22 and 5.24
  • multiple Configure options...
  • ship perl in a non default location: /usr/local/cpanel/3rdparty/perl/5XX/
  • can install more than one version at the same time
  • about ~50 patches: most of them sent upstream
  • 1060 cpan modules in a single git repo - custom yaml file + patches
  • tool for updating from CPAN
$>perl -V
Summary of my perl5 (revision 5 version 26 subversion 0) configuration:
   
  Platform:
    osname=linux
    osvers=3.10.0-123.20.1.el7.x86_64
    archname=x86_64-linux-64int
    uname='linux rpmbuild-64-centos-7.dev.cpanel.net 3.10.0-123.20.1.el7.x86_64 #1 smp thu jan 29 18:05:33 utc 2015 x86_64 x86_64 x86_64 gnulinux '
    config_args='-des -Dusedevel -Darchname=x86_64-linux-64int -Dcc=/usr/bin/gcc -Dcpp=/usr/bin/cpp -Dusemymalloc=n -DDEBUGGING=none -Doptimize=-Os -Accflags=-m64 -Dccflags=-DPERL_DISABLE_PMC -fPIC -DPIC -I/usr/local/cpanel/3rdparty/perl/526/include -I/usr/local/cpanel/3rdparty/include -L/usr/local/cpanel/3rdparty/lib64 -Duseshrplib -Duselargefiles=yes -Duseposix=true -Dhint=recommended -Duseperlio=yes -Dcppflags=-I/usr/local/cpanel/3rdparty/perl/526/include -I/usr/local/cpanel/3rdparty/include -L/usr/local/cpanel/3rdparty/lib64 -Dldflags=-L/usr/local/cpanel/3rdparty/lib64 -Dprefix=/usr/local/cpanel/3rdparty/perl/526 -Dsiteprefix=/opt/cpanel/perl5/526 -Dsitebin=/opt/cpanel/perl5/526/bin -Dsitelib=/opt/cpanel/perl5/526/site_lib -Dusevendorprefix=true -Dvendorbin=/usr/local/cpanel/3rdparty/perl/526/bin -Dvendorprefix=/usr/local/cpanel/3rdparty/perl/526/lib64/perl5 -Dvendorlib=/usr/local/cpanel/3rdparty/perl/526/lib64/perl5/cpanel_lib -Dprivlib=/usr/local/cpanel/3rdparty/perl/526/lib64/perl5/5.26.0 -Dman1dir=none -Dman3dir=none -Dscriptdir=/usr/local/cpanel/3rdparty/perl/526/bin -Dscriptdirexp=/usr/local/cpanel/3rdparty/perl/526/bin -Dsiteman1dir=none -Dsiteman3dir=none -Dinstallman1dir=none -Dversiononly=no -Dinstallusrbinperl=no -Dcf_by=cPanel -Dmyhostname=localhost -Dperladmin=root@localhost -Dcf_email=support@cpanel.net -Di_dbm=/usr/local/cpanel/3rdparty/include -Di_gdbm=/usr/local/cpanel/3rdparty/include -Di_ndbm=/usr/local/cpanel/3rdparty/include -DDB_File=true -Ud_dosuid -Uuserelocatableinc -Umad -Uusethreads -Uusemultiplicity -Uusesocks -Uuselongdouble -Aldflags=-L/usr/local/cpanel/3rdparty/lib64 -L/usr/lib64 -L/lib64 -lgdbm -Dlocincpth=/usr/local/cpanel/3rdparty/perl/526/include /usr/local/cpanel/3rdparty/include /usr/local/include  -Duse64bitint -Uuse64bitall -Dlibpth=/usr/local/cpanel/3rdparty/lib64 /usr/local/lib64 /usr/local/lib /lib64 /usr/lib64 '
    hint=recommended
    useposix=true
    d_sigaction=define
    useithreads=undef
    usemultiplicity=undef
    use64bitint=define
    use64bitall=undef
    uselongdouble=undef
    usemymalloc=n
    default_inc_excludes_dot=define
    bincompat5005=undef
  Compiler:
    cc='/usr/bin/gcc'
    ccflags ='-DPERL_DISABLE_PMC -fPIC -DPIC -I/usr/local/cpanel/3rdparty/perl/526/include -I/usr/local/cpanel/3rdparty/include -L/usr/local/cpanel/3rdparty/lib64 -m64 -fwrapv -fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -D_FORTIFY_SOURCE=2'
    optimize='-Os'
    cppflags='-I/usr/local/cpanel/3rdparty/perl/526/include -I/usr/local/cpanel/3rdparty/include -L/usr/local/cpanel/3rdparty/lib64 -DPERL_DISABLE_PMC -fPIC -DPIC -I/usr/local/cpanel/3rdparty/perl/526/include -I/usr/local/cpanel/3rdparty/include -L/usr/local/cpanel/3rdparty/lib64 -m64 -fwrapv -fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include'
    ccversion=''
    gccversion='4.8.2 20140120 (Red Hat 4.8.2-16)'
    gccosandvers=''
    intsize=4
    longsize=8
    ptrsize=8
    doublesize=8
    byteorder=12345678
    doublekind=3
    d_longlong=define
    longlongsize=8
    d_longdbl=define
    longdblsize=16
    longdblkind=3
    ivtype='long'
    ivsize=8
    nvtype='double'
    nvsize=8
    Off_t='off_t'
    lseeksize=8
    alignbytes=8
    prototype=define
  Linker and Libraries:
    ld='/usr/bin/gcc'
    ldflags ='-L/usr/local/cpanel/3rdparty/lib64 -L/usr/local/cpanel/3rdparty/lib64 -L/usr/lib64 -L/lib64 -lgdbm -fstack-protector-strong -L/usr/local/lib'
    libpth=/usr/local/cpanel/3rdparty/lib64 /usr/local/lib64 /usr/local/lib /lib64 /usr/lib64 /usr/local/lib /usr/lib /lib/../lib64 /usr/lib/../lib64 /lib
    libs=-lpthread -lnsl -lgdbm -ldb -ldl -lm -lcrypt -lutil -lc -lgdbm_compat
    perllibs=-lpthread -lnsl -ldl -lm -lcrypt -lutil -lc
    libc=libc-2.17.so
    so=so
    useshrplib=true
    libperl=libperl.so
    gnulibc_version='2.17'
  Dynamic Linking:
    dlsrc=dl_dlopen.xs
    dlext=so
    d_dlsymun=undef
    ccdlflags='-Wl,-E -Wl,-rpath,/usr/local/cpanel/3rdparty/perl/526/lib64/perl5/5.26.0/x86_64-linux-64int/CORE'
    cccdlflags='-fPIC'
    lddlflags='-shared -Os -L/usr/local/cpanel/3rdparty/lib64 -L/usr/lib64 -L/lib64 -L/usr/local/lib -fstack-protector-strong'


Characteristics of this binary (from libperl): 
  Compile-time options:
    HAS_TIMES
    PERLIO_LAYERS
    PERL_COPY_ON_WRITE
    PERL_DISABLE_PMC
    PERL_DONT_CREATE_GVSV
    PERL_MALLOC_WRAP
    PERL_OP_PARENT
    PERL_PRESERVE_IVUV
    PERL_USE_DEVEL
    USE_64_BIT_INT
    USE_LARGE_FILES
    USE_LOCALE
    USE_LOCALE_COLLATE
    USE_LOCALE_CTYPE
    USE_LOCALE_NUMERIC
    USE_LOCALE_TIME
    USE_PERLIO
    USE_PERL_ATOF
  Locally applied patches:
    cPanel patches
    cPanel INC path changes
    cPanel performance improvements to modules
    cPanel Immortal COW
    cPanel B and O performance fixups
    cPanel B::C Declare Static Memory malloc patches
    cPanel Disable XS handshake
  Built under linux
  Compiled at Sep 22 2017 11:10:09
  @INC:
    /usr/local/cpanel
    /usr/local/cpanel/3rdparty/perl/526/lib64/perl5/cpanel_lib/x86_64-linux-64int
    /usr/local/cpanel/3rdparty/perl/526/lib64/perl5/cpanel_lib
    /usr/local/cpanel/3rdparty/perl/526/lib64/perl5/5.26.0/x86_64-linux-64int
    /usr/local/cpanel/3rdparty/perl/526/lib64/perl5/5.26.0
    /opt/cpanel/perl5/526/site_lib/x86_64-linux-64int
    /opt/cpanel/perl5/526/site_lib

Tux - HP-UX

pro

5.14.2 /pro cc (HP C-ANSI-C)

unthreaded 64all No old modules: -Dextra="none" -Dinc_verlion_list="none"

csh=tcsh

Add PROCURA modules Add a shipload of "useful" modules (DBI, DBD*, CSV*, Tk, ...)

No test skipping, but (heavy) use of distroprefs (28 patches, 70 prefs)


HP-UX

whenever I have time http://mirrors.develooper.com/hpux/downloads.html

10.20: 5.22.1 11.00: 5.22.0 11.11: 5.24.0 11.23: 5.24.1 11.31: 5.24.1

/opt/perl32 /opt/perl64 64all longdouble

gcc

threaded No old modules: -Dextra="none" -Dinc_verlion_list="none"

csh=tcsh

update all modules to current (including core)

Add a shipload of "useful" modules (DBI, DBD*, CSV*, Tk, ...)

32bit NO XML & SSL 64bit XML, SSL

No test skipping, but (heavy) use of distroprefs (28 patches, 70 prefs)


Debian 5.14 LTS 5.20 supported 1 year Old Stable 5.24 - 5.26 -

Up to date - every 2 years? 5.28 for next release.

50 Patches against perl - https://sources.debian.net/src/perl/5.26.0-5/debian/patches/

  • Many old patches.
  • Fixes are upstreamable
  • All fixes are upstream in 5.26 except dual life.
  • Some dual life modules have a separate package
  • Building on 12 architectures + more unofficial ones.
  • Configure with threading and 64bitint
  • Perl split into multiple packages
  • /usr/bin/perl linked statically against libperl (not libperl.so)
  • perl-doc package for all man pages and pod files.
  • Cannot have multiple versions of perl installed at the same time
    • Perl is very integral to Debian
  • 200 open bugs about perl
    • Some ill defined
    • Some wishlist / bugs
    • Banned from CPAN folks

CPAN

  • Separate team. 100 contributors
  • non-arch packages only built on one platform.
  • 3500 Debian packages
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.