Machinekit-hal-xenomai Debian Jessie package has unmet dependencies

[cerna]

When trying to install Machinekit-HAL on Debian 8 Jessie system (both AMD64 and i386) with Xenomai kernel from Machinekit repository, there are unmet dependencies:

(Mentioned in discussion and in machinekit/machinekit#1462 .)

The following packages have unmet dependencies:
 machinekit-hal-xenomai : Depends: libboost-python1.62.0 but it is not installable or
                                   libboost-python1.62.0 but it is not installable
                          Depends: libboost-system1.62.0 but it is not installable or
                                   libboost-system1.67.0 but it is not installable
                          Depends: libboost-thread1.62.0 but it is not installable or
                                   libboost-thread1.62.0 but it is not installable
                          Depends: libprotobuf10 but it is not installable or
                                   libprotobuf17 but it is not installable
                          Depends: libstdc++6 (>= 5.2) but 4.9.2-10+deb8u2 is to be installed
                          Depends: libtinfo5 (>= 6) but 5.9+20140913-1+deb8u3 is to be installed
E: Unable to correct problems, you have held broken packages.

As the official Debian repository has only libboost*1.55, protobuf9 and libstdc++6 4.9.2 and libtinfo 5.9.

I see 3 possible solutions:

1. Lower the requested versions in a dependency specification
2. Add needed packages to Machinekit Jessie repository
3. Add documentation telling users to compile and install the aforementioned packages themselves

[ArcEye]

https://github.com/machinekit/machinekit-hal/blame/master/debian/control.xenomai.in

This commit came over from one for machinekit, where the debian structure differs.

Because the 'fix' for Buster was not limited to Buster builds, it breaks Jessie.
This should be in a control-buster.xenomai.in file or similar and configure altered to use it for Buster builds.

However this leads to another problem.
What should be happening is that libboost-*-dev is specified as a build-dep, not an install dep and the correct version for that distro will be used.

The packages build, because the dockers have all the required packages, but that is no use if they contain unattainable dependencies, which were not the ones the package was built against.

Needs looking at as a whole. These deps are common to all packages, the xenomai deps should just be xenomai-runtime really.

[zultron]

Whoops! Thanks for figuring out my mistake, @ArcEye.

[ArcEye]

Some of the mistakes before that were mine. You just built on them 😆

[ArcEye]

I have overhauled the package build for machinekit-hal and used the debhelper macros to insert the correct package dependencies, outside the specified ones.
ie. ${misc:Depends}, ${shlibs:Depends}, $(python:Depends}

This seems to arrive at the correct versioning for the distro build, libstdc++6 version for Jessie is (>=4.9) for instance.

@cerna
Are you able to test the install for Jessie?
A full set of Jessie amd64 packages (posix, rt-preempt and xenomai) are here for a couple of days
http://www.mgware.co.uk/temp/

[cerna]

(Not saying that I am not doing some stupid mistake.)

@ArcEye ,
for the machinekit-hal-xenomai and the machinekit-hal-rt-preempt there seems to be a dependency conflict. Both packages depends on the machinekit-hal-posix, however trying to install -xanomai after successful installation of -posix throws error:

de@Jessie64SATA:~/Desktop/mk$ sudo dpkg -i ./machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb
(Reading database ... 94203 files and directories currently installed.)
Preparing to unpack .../machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb ...
Unpacking machinekit-hal-rt-preempt (0.2.1557153686.git99a0286-1~jessie) over (0.2.1557153686.git99a0286-1~jessie) ...
dpkg: dependency problems prevent configuration of machinekit-hal-rt-preempt:
 machinekit-hal-rt-preempt depends on libcgroup1 (>= 0.36.2); however:
  Package libcgroup1:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libczmq4 (>= 3.0.2); however:
  Package libczmq4:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libjansson4 (>= 2.2); however:
  Package libjansson4:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libmodbus5 (>= 3.0.2); however:
  Package libmodbus5:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libprotobuf9; however:
  Package libprotobuf9:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libtk8.6 (>= 8.6.0); however:
  Package libtk8.6:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libxss1; however:
  Package libxss1:amd64 is not installed.
 machinekit-hal-rt-preempt depends on libzmq3 (>= 3.2.3+dfsg); however:
  Package libzmq3:amd64 is not installed.
 machinekit-hal-rt-preempt depends on machinekit-hal-posix; how
dpkg: error processing package machinekit-hal-rt-preempt (--install):
 dependency problems - leaving unconfigured
Errors were encountered while processing:
 machinekit-hal-rt-preempt

de@Jessie64SATA:~/Desktop/mk$ sudo apt-get -f install
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Correcting dependencies... Done
The following packages were automatically installed and are no longer required:
  blt cgroup-tools freeglut3 libcgroup1 libczmq4 libgtkglext1 libjansson4
  libmodbus5 libpgm-5.1-0 libprotobuf9 libsodium13 libtcl8.6 libtk-img
  libtk8.6 libxss1 libzmq3 python-avahi python-configobj python-gdbm
  python-gtkglext1 python-opengl python-protobuf python-pyftpdlib
  python-sendfile python-simplejson python-tk python-xlib python-zmq tcl
  tcl-tclreadline tcl8.6 tk8.6 tk8.6-blt2.5
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
  blt cgroup-tools freeglut3 libcgroup1 libczmq4 libgtkglext1 libjansson4
  libmodbus5 libpgm-5.1-0 libprotobuf9 libsodium13 libtcl8.6 libtk-img
  libtk8.6 libxss1 libzmq3 python-avahi python-configobj python-gdbm
  python-gtkglext1 python-opengl python-protobuf python-pyftpdlib
  python-sendfile python-simplejson python-tk python-xlib python-zmq tcl
  tcl-tclreadline tcl8.6 tk8.6 tk8.6-blt2.5
Suggested packages:
  blt-demo libtk-img-doc python-configobj-doc python-gdbm-dbg libgle3 tix
  python-tk-dbg
The following packages will be REMOVED:
  machinekit-hal-rt-preempt
The following NEW packages will be installed:
  blt cgroup-tools freeglut3 libcgroup1 libczmq4 libgtkglext1 libjansson4
  libmodbus5 libpgm-5.1-0 libprotobuf9 libsodium13 libtcl8.6 libtk-img
  libtk8.6 libxss1 libzmq3 python-avahi python-configobj python-gdbm
  python-gtkglext1 python-opengl python-protobuf python-pyftpdlib
  python-sendfile python-simplejson python-tk python-xlib python-zmq tcl
  tcl-tclreadline tcl8.6 tk8.6 tk8.6-blt2.5
0 upgraded, 33 newly installed, 1 to remove and 0 not upgraded.
1 not fully installed or removed.
Need to get 0 B/5,658 kB of archives.
After this operation, 9,466 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Extracting templates from packages: 100%
(Reading database ... 94203 files and directories currently installed.)
Removing machinekit-hal-rt-preempt (0.2.1557153686.git99a0286-1~jessie) ...
Processing triggers for libc-bin (2.19-18+deb8u10) ...
Selecting previously unselected package freeglut3:amd64.
(Reading database ... 93610 files and directories currently installed.)
Preparing to unpack .../freeglut3_2.8.1-2_amd64.deb ...
Unpacking freeglut3:amd64 (2.8.1-2) ...
Selecting previously unselected package libpgm-5.1-0.
Preparing to unpack .../libpgm-5.1-0_5.1.118-1~dfsg-1_amd64.deb ...
Unpacking libpgm-5.1-0 (5.1.118-1~dfsg-1) ...
Selecting previously unselected package libsodium13:amd64.
Preparing to unpack .../libsodium13_1.0.0-1_amd64.deb ...
Unpacking libsodium13:amd64 (1.0.0-1) ...
Selecting previously unselected package libzmq3:amd64.
Preparing to unpack .../libzmq3_4.0.5+dfsg-2+deb8u1_amd64.deb ...
Unpacking libzmq3:amd64 (4.0.5+dfsg-2+deb8u1) ...
Selecting previously unselected package libczmq4:amd64.
Preparing to unpack .../libczmq4_4.0.2-10~jessie_amd64.deb ...
Unpacking libczmq4:amd64 (4.0.2-10~jessie) ...
Selecting previously unselected package libjansson4:amd64.
Preparing to unpack .../libjansson4_2.7-1+deb8u1_amd64.deb ...
Unpacking libjansson4:amd64 (2.7-1+deb8u1) ...
Selecting previously unselected package libtcl8.6:amd64.
Preparing to unpack .../libtcl8.6_8.6.2+dfsg-2_amd64.deb ...
Unpacking libtcl8.6:amd64 (8.6.2+dfsg-2) ...
Selecting previously unselected package libxss1:amd64.
Preparing to unpack .../libxss1_1%3a1.2.2-1_amd64.deb ...
Unpacking libxss1:amd64 (1:1.2.2-1) ...
Selecting previously unselected package libtk8.6:amd64.
Preparing to unpack .../libtk8.6_8.6.2-1_amd64.deb ...
Unpacking libtk8.6:amd64 (8.6.2-1) ...
Selecting previously unselected package libcgroup1:amd64.
Preparing to unpack .../libcgroup1_0.41-6+deb8u1_amd64.deb ...
Unpacking libcgroup1:amd64 (0.41-6+deb8u1) ...
Selecting previously unselected package libmodbus5:amd64.
Preparing to unpack .../libmodbus5_3.0.6-1_amd64.deb ...
Unpacking libmodbus5:amd64 (3.0.6-1) ...
Selecting previously unselected package tk8.6-blt2.5.
Preparing to unpack .../tk8.6-blt2.5_2.5.3+dfsg-1_amd64.deb ...
Unpacking tk8.6-blt2.5 (2.5.3+dfsg-1) ...
Selecting previously unselected package blt.
Preparing to unpack .../blt_2.5.3+dfsg-1_amd64.deb ...
Unpacking blt (2.5.3+dfsg-1) ...
Selecting previously unselected package cgroup-tools.
Preparing to unpack .../cgroup-tools_0.41-6+deb8u1_amd64.deb ...
Unpacking cgroup-tools (0.41-6+deb8u1) ...
Selecting previously unselected package libgtkglext1.
Preparing to unpack .../libgtkglext1_1.2.0-3.2_amd64.deb ...
Unpacking libgtkglext1 (1.2.0-3.2) ...
Selecting previously unselected package libprotobuf9:amd64.
Preparing to unpack .../libprotobuf9_2.6.1-1_amd64.deb ...
Unpacking libprotobuf9:amd64 (2.6.1-1) ...
Selecting previously unselected package libtk-img:amd64.
Preparing to unpack .../libtk-img_1%3a1.4.2+dfsg-2+b4_amd64.deb ...
Unpacking libtk-img:amd64 (1:1.4.2+dfsg-2+b4) ...
Selecting previously unselected package python-gdbm.
Preparing to unpack .../python-gdbm_2.7.8-2+b1_amd64.deb ...
Unpacking python-gdbm (2.7.8-2+b1) ...
Selecting previously unselected package python-avahi.
Preparing to unpack .../python-avahi_0.6.31-5_amd64.deb ...
Unpacking python-avahi (0.6.31-5) ...
Selecting previously unselected package python-configobj.
Preparing to unpack .../python-configobj_5.0.6-1_all.deb ...
Unpacking python-configobj (5.0.6-1) ...
Selecting previously unselected package python-opengl.
Preparing to unpack .../python-opengl_3.0.2-1_all.deb ...
Unpacking python-opengl (3.0.2-1) ...
Selecting previously unselected package python-protobuf.
Preparing to unpack .../python-protobuf_2.6.1-1_amd64.deb ...
Unpacking python-protobuf (2.6.1-1) ...
Selecting previously unselected package python-pyftpdlib.
Preparing to unpack .../python-pyftpdlib_1.2.0-1_all.deb ...
Unpacking python-pyftpdlib (1.2.0-1) ...
Selecting previously unselected package python-sendfile.
Preparing to unpack .../python-sendfile_2.0.0-6_amd64.deb ...
Unpacking python-sendfile (2.0.0-6) ...
Selecting previously unselected package python-simplejson.
Preparing to unpack .../python-simplejson_3.6.5-1_amd64.deb ...
Unpacking python-simplejson (3.6.5-1) ...
Selecting previously unselected package python-tk.
Preparing to unpack .../python-tk_2.7.8-2+b1_amd64.deb ...
Unpacking python-tk (2.7.8-2+b1) ...
Selecting previously unselected package python-zmq.
Preparing to unpack .../python-zmq_14.4.0-1_amd64.deb ...
Unpacking python-zmq (14.4.0-1) ...
Selecting previously unselected package tcl8.6.
Preparing to unpack .../tcl8.6_8.6.2+dfsg-2_amd64.deb ...
Unpacking tcl8.6 (8.6.2+dfsg-2) ...
Selecting previously unselected package tcl.
Preparing to unpack .../archives/tcl_8.6.0+8_amd64.deb ...
Unpacking tcl (8.6.0+8) ...
Selecting previously unselected package tcl-tclreadline:amd64.
Preparing to unpack .../tcl-tclreadline_2.1.0-14_amd64.deb ...
Unpacking tcl-tclreadline:amd64 (2.1.0-14) ...
Selecting previously unselected package tk8.6.
Preparing to unpack .../tk8.6_8.6.2-1_amd64.deb ...
Unpacking tk8.6 (8.6.2-1) ...
Selecting previously unselected package python-gtkglext1.
Preparing to unpack .../python-gtkglext1_1.1.0-9.1_amd64.deb ...
Unpacking python-gtkglext1 (1.1.0-9.1) ...
Selecting previously unselected package python-xlib.
Preparing to unpack .../python-xlib_0.14+20091101-1_all.deb ...
Unpacking python-xlib (0.14+20091101-1) ...
Processing triggers for man-db (2.7.0.2-5) ...
Processing triggers for install-info (5.2.0.dfsg.1-6) ...
Setting up freeglut3:amd64 (2.8.1-2) ...
Setting up libpgm-5.1-0 (5.1.118-1~dfsg-1) ...
Setting up libsodium13:amd64 (1.0.0-1) ...
Setting up libzmq3:amd64 (4.0.5+dfsg-2+deb8u1) ...
Setting up libczmq4:amd64 (4.0.2-10~jessie) ...
Setting up libjansson4:amd64 (2.7-1+deb8u1) ...
Setting up libtcl8.6:amd64 (8.6.2+dfsg-2) ...
Setting up libxss1:amd64 (1:1.2.2-1) ...
Setting up libtk8.6:amd64 (8.6.2-1) ...
Setting up libcgroup1:amd64 (0.41-6+deb8u1) ...
Setting up libmodbus5:amd64 (3.0.6-1) ...
Setting up tk8.6-blt2.5 (2.5.3+dfsg-1) ...
Setting up blt (2.5.3+dfsg-1) ...
Setting up cgroup-tools (0.41-6+deb8u1) ...
Setting up libgtkglext1 (1.2.0-3.2) ...
Setting up libprotobuf9:amd64 (2.6.1-1) ...
Setting up libtk-img:amd64 (1:1.4.2+dfsg-2+b4) ...
Setting up python-gdbm (2.7.8-2+b1) ...
Setting up python-avahi (0.6.31-5) ...
Setting up python-configobj (5.0.6-1) ...
Setting up python-opengl (3.0.2-1) ...
Setting up python-protobuf (2.6.1-1) ...
Setting up python-pyftpdlib (1.2.0-1) ...
Setting up python-sendfile (2.0.0-6) ...
Setting up python-simplejson (3.6.5-1) ...
Setting up python-tk (2.7.8-2+b1) ...
Setting up python-zmq (14.4.0-1) ...
Setting up tcl8.6 (8.6.2+dfsg-2) ...
Setting up tcl (8.6.0+8) ...
Setting up tcl-tclreadline:amd64 (2.1.0-14) ...
Setting up tk8.6 (8.6.2-1) ...
Setting up python-gtkglext1 (1.1.0-9.1) ...
Setting up python-xlib (0.14+20091101-1) ...
Processing triggers for libc-bin (2.19-18+deb8u10) ...
Processing triggers for python-support (1.0.15) ...
de@Jessie64SATA:~/Desktop/mk$ sudo dpkg -i ./machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb
Selecting previously unselected package machinekit-hal-rt-preempt.
(Reading database ... 97018 files and directories currently installed.)
Preparing to unpack .../machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb ...
Unpacking machinekit-hal-rt-preempt (0.2.1557153686.git99a0286-1~jessie) ...
dpkg: dependency problems prevent configuration of machinekit-hal-rt-preempt:
 machinekit-hal-rt-preempt depends on machinekit-hal-posix; however:
  Package machinekit-hal-posix is not installed.

dpkg: error processing package machinekit-hal-rt-preempt (--install):
 dependency problems - leaving unconfigured
Errors were encountered while processing:
 machinekit-hal-rt-preempt

de@Jessie64SATA:~/Desktop/mk$ ls
machinekit-hal-posix_0.2.1557153686.git99a0286-1~jessie_amd64.deb
machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb
machinekit-hal-xenomai_0.2.1557153686.git99a0286-1~jessie_amd64.deb
de@Jessie64SATA:~/Desktop/mk$ sudo dpkg -i machinekit-hal-posix_0.2.1557153686.git99a0286-1~jessie_amd64.deb machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb
(Reading database ... 97011 files and directories currently installed.)
Preparing to unpack machinekit-hal-posix_0.2.1557153686.git99a0286-1~jessie_amd64.deb ...
Unpacking machinekit-hal-posix (0.2.1557153686.git99a0286-1~jessie) ...
Selecting previously unselected package machinekit-hal-rt-preempt.
Preparing to unpack machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb ...
Unpacking machinekit-hal-rt-preempt (0.2.1557153686.git99a0286-1~jessie) ...
dpkg: error processing archive machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb (--install):
 trying to overwrite '/etc/modprobe.d/linuxcnc.conf', which is also in package machinekit-hal-posix 0.2.1557153686.git99a0286-1~jessie
dpkg-deb: error: subprocess paste was killed by signal (Broken pipe)
Setting up machinekit-hal-posix (0.2.1557153686.git99a0286-1~jessie) ...
Valid MKUUID in mkuuid 68061cbc-0084-49fc-89c3-00897ed274e1 - using that
Old value in /etc/linuxcnc/machinekit.ini replaced with new MKUUID 68061cbc-0084-49fc-89c3-00897ed274e1
Errors were encountered while processing:
machinekit-hal-rt-preempt_0.2.1557153686.git99a0286-1~jessie_amd64.deb

Otherwise, the machinekit-hal-posix installs and runs without problems.

[ArcEye]

OK, there is something screwy there.

I can see that the machinekit-hal-posix dep has been inserted by the macros, in xenomai and rt-preempt, but unsure why that is.
It is not in the machinekit-hal-posix control file, it should not be in any of them.

Thanks for testing, I will look at it again later and try to find where this is coming from.

[ArcEye]

@cerna
Think I have sorted it now.
Could not get the macros to work properly, but extracted the package versions etc per distro and use those in the control file, seems to work OK.

A full set of the new Jessie amd64 packages (posix, rt-preempt and xenomai) are here again.
http://www.mgware.co.uk/temp/
if you could do a test install please.

[ArcEye]

Hopefully this commit will fix the problems you had and prevent others.
#203

[cerna]

@ArcEye ,

Yes, packages seems to install OK. They are not mutually exclusive (i.e. trying to install machinekit-hal-xenomai over machinekit-hal-posix will throw on trying to overwrite '/etc/modprobe.d/linuxcnc.conf', which is also in package machinekit-hal-xenomai 0.2.1557333844.git9b9dfc7-1~jessie and not on conflicts property).

Interesting thing is that OUT OF MEMORY epoll.cpp error. The same system, the exact same packages and on Xenomai it is present and on RT-PREEMPT it is not.

[ArcEye]

I can add a Conflicts: line for now.

When the work to remove the 'for each flavour' builds comes in, amongst other things we should be able to do away with a lot of the flavour stuff and have a main machinekit-hal package, with a few flavour dependent bits in a machinekit-hal-<flavour> package.

Interesting thing is that OUT OF MEMORY epoll.cpp error. The same system, the exact same packages and on Xenomai it is present and on RT-PREEMPT it is not.

Strange, AFAIR that error seemed likely to be related to czmq, but maybe not.

Thanks for testing

[ArcEye]

On 09/05/19 16:28, cerna wrote:

@ArcEye , hasn't the repository just been killed by this change? Seems everything was updated today and many packages are missing.

No, I am rebuilding the whole repository, because the definitions for Buster have disappeared and the database file is corrupt. This became apparant after a mksocfpga commit. Nothing to do with the machinekit-hal commits I don't know where you wrote this, it does not appear in the issue.

[cerna]

I come across this when there were only machinekit-hal and machinekit packages in Machinekit Debian repository and prematurely reached the conclusion that something went very wrong. After I started chasing reason why my installation cannot download package when it could yesterday, I discovered that packages are slowly popping up in the repository, so I reached the conclusion that something triggered a whole rebuild and retracted my comment as it was unnecessarily alarmist.

I can add a Conflicts: line for now.

Thank you.

Strange, AFAIR that error seemed likely to be related to czmq, but maybe not.

It is. I am going to test it against the official ZeroMQ repository.

I don't think it should have anything to do with Xenomai's smaller stack size, as it is not RT and not crashing completely.

[cerna]

How long does the complete rebuild take? Because it looks like some packages (xenomai-runtime for amd64 for example) were not build yet.

[ArcEye]

It was manual and it finished yesterday.

AFAICT there was never an amd64 xenomai-runtime package.
Or if there was it was deleted a long time ago.

All the old packages are in http://deb.machinekit.io/archives/ and there is not a single amd64 package for wheezy or jessie in xenomai-runtime.
My own repo which has the xenomai packages copied across from machinekit some years ago does not have amd64 either