Problem with starting monetdb on debian sqeeze

[monetdb-team]

Date: 2013-04-22 11:08:04 +0200
From: konstantin.parshikov
To: Merovingian devs <>
Version: 11.15.3 (Feb2013-SP1)
CC: konstantin.parshikov

Last updated: 2013-04-29 14:51:28 +0200

Comment 18686

Date: 2013-04-22 11:08:04 +0200
From: konstantin.parshikov

User-Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.31 (KHTML, like Gecko) Chrome/26.0.1410.64 Safari/537.31
Build Identifier:

Linux dw1-1 3.2.0-0.bpo.4-amd64 1 SMP Debian 3.2.32-1~bpo60+1 x86_64

When I'm trying ot start up database I've got following:

$ monetdb start dw
starting database 'dw'... FAILED
start: starting 'dw' failed: database 'dw' started up, but failed to open up a communication channel

merovingian.log

2013-04-17 13:34:58 MSG merovingian[8295]: starting database 'dw', up min/avg/max: 0s/0s/1s, crash average: 0.00 0.00 0.00 (5-5=0)
2013-04-17 13:34:59 MSG merovingian[8295]: sending process 10095 (database 'dw') the TERM signal
2013-04-17 13:34:59 MSG dw[10095]: arguments: /usr/bin/mserver5 --dbpath=/var/lib/monetdb/dw --set merovingian_uri=mapi:monetdb://dw1-1:50000/dw --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/lib/monetdb/dw/.mapi.sock --set monet_vault_key=/var/lib/monetdb/dw/.vaultkey --set gdk_nr_threads=16 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes
2013-04-17 13:34:59 MSG dw[10095]: MonetDB 5 server v11.15.3 "Feb2013-SP1"
2013-04-17 13:34:59 MSG dw[10095]: Serving database 'dw', using 16 threads
2013-04-17 13:34:59 MSG dw[10095]: Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked
2013-04-17 13:34:59 MSG dw[10095]: Found 11.755 GiB available main-memory.
2013-04-17 13:34:59 MSG dw[10095]: Copyright (c) 1993-July 2008 CWI.
2013-04-17 13:34:59 MSG dw[10095]: Copyright (c) August 2008-2013 MonetDB B.V., all rights reserved
2013-04-17 13:34:59 MSG dw[10095]: Visit http://www.monetdb.org/ for further information
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.rank_grp[3]:object code for command sql.rank_grp missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.rank_grp[1]:object code for command sql.rank missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.rank_grp[1]:object code for command sql.rank missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.dense_rank_grp[3]:object code for command sql.dense_rank_grp missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.dense_rank_grp[1]:object code for command sql.dense_rank missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:batcalc.dense_rank_grp[1]:object code for command sql.dense_rank missing
2013-04-17 13:34:59 MSG dw[10095]: WARNING: LoaderException:loadLibrary:Loading error could not locate library lsst (from within file 'lsst')
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:user.main[1228]:object code for command sql.prelude missing
2013-04-17 13:34:59 MSG dw[10095]: !TypeException:user.main[1228]:'sql.prelude' undefined in: _1228:void := sql.prelude()
2013-04-17 13:34:59 MSG merovingian[8295]: database 'dw' (10095) has exited with exit status 0
2013-04-17 13:34:59 MSG merovingian[8295]: database 'dw' has shut down
2013-04-17 13:34:59 ERR merovingian[8295]: client error: database 'dw' started up, but failed to open up a communication channel

Reproducible: Always

Steps to Reproduce:

1.Install monetdb
2.create db dw
3. monetdb start dw

Comment 18687

Date: 2013-04-22 14:23:04 +0200
From: @sjoerdmullender

I can reproduce it. There is a problem with packaging for Debian squeeze. The Ubuntu packages don't have this problem, even though they are created in exactly the same way.

The workaround is: as root run:
cd /usr/lib/monetdb5
for i in *.cpython-31mu.so; do mv $i ${i%.cpython-31mu.so}.so; done

In other words, in the /usr/lib/monetdb5 directory, rename all files that end in .cpython-31mu.so to the equivalent file without the ".cpython-31mu" bit.

Comment 18688

Date: 2013-04-22 15:19:07 +0200
From: konstantin.parshikov

Thanks.
After renaming i have new problem

monetdb start dw
starting database 'dw'... FAILED
start: starting 'dw' failed: database 'dw' appears to shut itself down after starting, check monetdbd's logfile for possible hints

merovingian.log

2013-04-22 13:04:49 MSG merovingian[11774]: starting database 'dw', up min/avg/max: 0s/0s/0s, crash average: 0.00 0.00 0.00 (2-2=0)
2013-04-22 13:04:49 MSG dw[12441]: arguments: /usr/bin/mserver5 --dbpath=/var/lib/monetdb/dw --set merovingian_uri=mapi:monetdb://dw1-1:50000/dw --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/lib/monetdb/dw/.mapi.sock --set monet_vault_key=/var/lib/monetdb/dw/.vaultkey --set gdk_nr_threads=16 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes
2013-04-22 13:04:49 MSG dw[12441]: MonetDB 5 server v11.15.3 "Feb2013-SP1"
2013-04-22 13:04:49 MSG dw[12441]: Serving database 'dw', using 16 threads
2013-04-22 13:04:49 MSG dw[12441]: Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked
2013-04-22 13:04:49 MSG dw[12441]: Found 11.755 GiB available main-memory.
2013-04-22 13:04:49 MSG dw[12441]: Copyright (c) 1993-July 2008 CWI.
2013-04-22 13:04:49 MSG dw[12441]: Copyright (c) August 2008-2013 MonetDB B.V., all rights reserved
2013-04-22 13:04:49 MSG dw[12441]: Visit http://www.monetdb.org/ for further information
2013-04-22 13:04:49 MSG dw[12441]: !MALException:malInclude:could not open file: mal_init
2013-04-22 13:04:49 MSG merovingian[11774]: database 'dw' (12441) has exited with exit status 0
2013-04-22 13:04:49 ERR control[11774]: (local): failed to fork mserver: database 'dw' appears to shut itself down after starting, check monetdbd's logfile for possible hints

Comment 18689

Date: 2013-04-22 16:13:59 +0200
From: @sjoerdmullender

(In reply to comment 2)

2013-04-22 13:04:49 MSG dw[12441]: !MALException:malInclude:could not open
file: mal_init

There should be a file call mal_init.mal in the same directory /usr/lib/monetdb5. Can you check whether that's there?

After having done the renames I was able to start the server, so I can't reproduce this latest problem.

Comment 18690

Date: 2013-04-22 16:34:01 +0200
From: @grobian

(In reply to comment 1)

The workaround is: as root run:
cd /usr/lib/monetdb5
for i in *.cpython-31mu.so; do mv $i ${i%.cpython-31mu.so}.so; done

this sounds as the python multiarch thing, perhaps this is an upgraded install?

Comment 18691

Date: 2013-04-22 16:36:12 +0200
From: @sjoerdmullender

(In reply to comment 4)

(In reply to comment 1)

The workaround is: as root run:
cd /usr/lib/monetdb5
for i in *.cpython-31mu.so; do mv $i ${i%.cpython-31mu.so}.so; done

this sounds as the python multiarch thing, perhaps this is an upgraded
install?

It also happens on a new install (I tried).
The problem is in the Debian build system, and specifically in the script dh_python3 which does a rename of all .so files it encounters.

Comment 18692

Date: 2013-04-22 17:14:29 +0200
From: konstantin.parshikov

/usr/lib/monetdb5 ls -l
total 1468
drwxr-xr-x 2 root root 4096 Apr 22 12:59 autoload
-rw-r--r-- 1 root root 808 Feb 27 15:23 cache.sql
drwxr-xr-x 2 root root 4096 Apr 22 12:59 createdb
-rw-r--r-- 1 root root 1356576 Feb 27 15:23 lib_sql.so
-rw-r--r-- 1 root root 1502 Feb 27 15:23 lsst.sql
-rw-r--r-- 1 root root 1879 Feb 27 15:23 octopus.sql
-rw-r--r-- 1 root root 777 Feb 27 15:23 parts.sql
-rw-r--r-- 1 root root 102374 Feb 27 15:23 sql.mal
-rw-r--r-- 1 root root 850 Feb 27 15:23 temporal.sql
-rw-r--r-- 1 root root 1727 Feb 27 15:23 vault.sql

Comment 18693

Date: 2013-04-22 17:28:34 +0200
From: @sjoerdmullender

It looks like you have only installed the monetdb5-sql package and not the packages it depends on.
When I try to install monetdb5-sql with apt-get, I see:

The following extra packages will be installed:
libmonetdb-client6 libmonetdb-stream3 libmonetdb9 monetdb5-server
The following NEW packages will be installed:
libmonetdb-client6 libmonetdb-stream3 libmonetdb9 monetdb5-server
monetdb5-sql
0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded.

The package monetdb5-server provides the mal_init.mal file you were missing (and a lot else besides).

Comment 18694

Date: 2013-04-23 14:12:11 +0200
From: @sjoerdmullender

The original bug seems to be fixed by changeset 054957d3e8ca
If the problem of comment 2 is not fixed, it should be entered as a new bug.

Comment 18695

Date: 2013-04-23 16:00:55 +0200
From: konstantin.parshikov

Thanks.
Db start up after apt-get remove libmonetdb-client6 libmonetdb-stream3 libmonetdb9 monetdb5-server monetdb5-sql monetdb-client and new installation.