Querying "sys"."tracelog" causes assertion violation and crash of mserver5 process

[monetdb-team]

Date: 2015-12-17 13:21:55 +0100
From: Martin van Dinther <<martin.van.dinther>>
To: SQL devs <>
Version: -- development
CC: @njnes

Last updated: 2016-01-15 11:38:15 +0100

Comment 21669

Date: 2015-12-17 13:21:55 +0100
From: Martin van Dinther <<martin.van.dinther>>

User-Agent: Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:42.0) Gecko/20100101 Firefox/42.0
Build Identifier:

BBPkeepref: range error 50462774
mserver5: ../../dev/gdk/gdk_bbp.c:2470: getBBPdescriptor: Assertion `BBP[abs(i)>>14][abs(i)&((1 << 14)-1)].refs' failed.
./start_INSTALL_mserver5.sh: line 6: 9522 Aborted (core dumped) /export/scratch2/dinther_scratch1/INSTALL/bin/mserver5 -d10 --set embedded_r=true --set mapi_port=41000

Reproducible: Always

Steps to Reproduce:

1. Start mserver5 (built from default branch with assertions enabled)
2. Start mclient
3. Issue SQL queries for all (currently 15) system views:
   select count() from "sys"."columns";
   select count() from "sys"."environment";
   select count() from "sys"."optimizers";
   select count() from "sys"."querylog_calls";
   select count() from "sys"."querylog_catalog";
   select count() from "sys"."querylog_history";
   select count() from "sys"."queue";
   select count() from "sys"."rejects";
   select count() from "sys"."sessions";
   select count() from "sys"."storage";
   select count() from "sys"."storagemodel";
   select count() from "sys"."tables";
   select count() from "sys"."tablestoragemodel";
   select count() from "sys"."tracelog";
   select count(*) from "sys"."users";

Actual Results:

builtin opt gdk_dbpath = /export/scratch2/dinther_scratch1/INSTALL/var/monetdb5/dbfarm/demo
builtin opt gdk_debug = 0
builtin opt gdk_vmtrim = no
builtin opt monet_prompt = >
builtin opt monet_daemon = no
builtin opt mapi_port = 50000
builtin opt mapi_open = false
builtin opt mapi_autosense = false
builtin opt sql_optimizer = default_pipe
builtin opt sql_debug = 0
cmdline opt embedded_r = true
cmdline opt mapi_port = 41000
cmdline opt gdk_debug = 10
MonetDB 5 server v11.22.0
This is an unreleased version
Serving database 'demo', using 8 threads
Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs and 128bit integers dynamically linked
Found 15.589 GiB available main-memory.
Copyright (c) 1993-July 2008 CWI.
Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved
Visit http://www.monetdb.org/ for further information
Listening for connection requests on mapi:monetdb://127.0.0.1:41000/
MonetDB/GIS module loaded
Start processing logs sql/sql_logs version 52200
Finished processing logs sql/sql_logs
MonetDB/SQL module loaded
MonetDB/R module loaded

SQL catalog created, loading sql scripts once
loading sql script: 09_like.sql
loading sql script: 10_math.sql
loading sql script: 11_times.sql
loading sql script: 12_url.sql
loading sql script: 13_date.sql
loading sql script: 14_inet.sql
loading sql script: 15_querylog.sql
loading sql script: 16_tracelog.sql
loading sql script: 17_temporal.sql
loading sql script: 20_vacuum.sql
loading sql script: 21_dependency_functions.sql
loading sql script: 22_clients.sql
loading sql script: 23_skyserver.sql
loading sql script: 24_zorder.sql
loading sql script: 25_debug.sql
loading sql script: 26_sysmon.sql
loading sql script: 27_rejects.sql
loading sql script: 39_analytics.sql
loading sql script: 39_analytics_hge.sql
loading sql script: 40_geom.sql
loading sql script: 40_json.sql
loading sql script: 40_json_hge.sql
loading sql script: 41_md5sum.sql
loading sql script: 45_uuid.sql
loading sql script: 46_gsl.sql
loading sql script: 46_profiler.sql
loading sql script: 51_sys_schema_extension.sql
loading sql script: 72_fits.sql
loading sql script: 74_netcdf.sql
loading sql script: 75_storagemodel.sql
loading sql script: 80_statistics.sql
loading sql script: 80_udf.sql
loading sql script: 80_udf_hge.sql
loading sql script: 85_bam.sql
loading sql script: 90_generator.sql
loading sql script: 90_generator_hge.sql
loading sql script: 99_system.sql
WARNING To speedup user.columnsize a bulk operator implementation is needed
X_59:bat[:oid,:lng] := mal.multiplex("user":str,"columnsize":str,X_44:bat[:oid,:str],X_51:bat[:oid,:lng],X_58:bat[:oid,:lng]);
WARNING To speedup user.heapsize a bulk operator implementation is needed
X_69:bat[:oid,:lng] := mal.multiplex("user":str,"heapsize":str,X_44:bat[:oid,:str],X_58:bat[:oid,:lng],X_68:bat[:oid,:int]);
WARNING To speedup user.hashsize a bulk operator implementation is needed
X_78:bat[:oid,:lng] := mal.multiplex("user":str,"hashsize":str,X_77:bat[:oid,:bit],X_51:bat[:oid,:lng]);
WARNING To speedup user.imprintsize a bulk operator implementation is needed
X_80:bat[:oid,:lng] := mal.multiplex("user":str,"imprintsize":str,X_51:bat[:oid,:lng],X_44:bat[:oid,:str]);
BBPkeepref: range error 50462774
mserver5: ../../dev/gdk/gdk_bbp.c:2470: getBBPdescriptor: Assertion `BBP[abs(i)>>14][abs(i)&((1 << 14)-1)].refs' failed.
./start_INSTALL_mserver5.sh: line 6: 9522 Aborted (core dumped) /export/scratch2/dinther_scratch1/INSTALL/bin/mserver5 -d10 --set embedded_r=true --set mapi_port=41000

bash-4.3$ mclient -p 41000
Welcome to mclient, the MonetDB/SQL interactive terminal (unreleased)
Database: MonetDB v11.22.0 (unreleased), 'demo'
Type \q to quit, ? for a list of available commands
auto commit mode: on
sql>select count() from "sys"."columns";
+------+
| L1 |
+======+
| 361 |
+------+
1 tuple (1.623ms)
sql>select count() from "sys"."environment";
+------+
| L1 |
+======+
| 22 |
+------+
1 tuple (0.761ms)
sql>select count() from "sys"."optimizers";
+------+
| L1 |
+======+
| 4 |
+------+
1 tuple (0.737ms)
sql>select count() from "sys"."querylog_calls";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (557.079ms)
sql>select count() from "sys"."querylog_catalog";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (1.453ms)
sql>select count() from "sys"."querylog_history";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (2.040ms)
sql>select count() from "sys"."queue";
+------+
| L1 |
+======+
| 1 |
+------+
1 tuple (0.762ms)
sql>select count() from "sys"."rejects";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (0.666ms)
sql>select count() from "sys"."sessions";
+------+
| L1 |
+======+
| 2 |
+------+
1 tuple (0.750ms)
sql>select count() from "sys"."storage";
+------+
| L1 |
+======+
| 250 |
+------+
1 tuple (4.209ms)
sql>select count() from "sys"."storagemodel";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (10.755ms)
sql>select count() from "sys"."tables";
+------+
| L3 |
+======+
| 54 |
+------+
1 tuple (59.083ms)
sql>select count() from "sys"."tablestoragemodel";
+------+
| L7 |
+======+
| 0 |
+------+
1 tuple (3.693ms)
sql>select count() from "sys"."tracelog";
sql>select count(*) from "sys"."users";
bash-4.3$

Expected Results:

bash-4.3$ mclient
Welcome to mclient, the MonetDB/SQL interactive terminal (unreleased)
Database: MonetDB v11.22.0 (unreleased), 'demo'
Type \q to quit, ? for a list of available commands
auto commit mode: on
sql>select count() from "sys"."columns";
+------+
| L1 |
+======+
| 361 |
+------+
1 tuple (1.623ms)
sql>select count() from "sys"."environment";
+------+
| L1 |
+======+
| 22 |
+------+
1 tuple (0.761ms)
sql>select count() from "sys"."optimizers";
+------+
| L1 |
+======+
| 4 |
+------+
1 tuple (0.737ms)
sql>select count() from "sys"."querylog_calls";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (557.079ms)
sql>select count() from "sys"."querylog_catalog";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (1.453ms)
sql>select count() from "sys"."querylog_history";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (2.040ms)
sql>select count() from "sys"."queue";
+------+
| L1 |
+======+
| 1 |
+------+
1 tuple (0.762ms)
sql>select count() from "sys"."rejects";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (0.666ms)
sql>select count() from "sys"."sessions";
+------+
| L1 |
+======+
| 2 |
+------+
1 tuple (0.750ms)
sql>select count() from "sys"."storage";
+------+
| L1 |
+======+
| 250 |
+------+
1 tuple (4.209ms)
sql>select count() from "sys"."storagemodel";
+------+
| L1 |
+======+
| 0 |
+------+
1 tuple (10.755ms)
sql>select count() from "sys"."tables";
+------+
| L3 |
+======+
| 54 |
+------+
1 tuple (59.083ms)
sql>select count() from "sys"."tablestoragemodel";
+------+
| L7 |
+======+
| 0 |
+------+
1 tuple (3.693ms)
sql>select count() from "sys"."tracelog";
+------+
| L7 |
+======+
| 0 |
+------+
1 tuple (3.693ms)
sql>select count(*) from "sys"."users";
+------+
| L7 |
+======+
| 1 |
+------+
1 tuple (3.693ms)

No assertion violation. No crash of mserver5 proces.

Comment 21670

Date: 2015-12-17 14:27:45 +0100
From: MonetDB Mercurial Repository <>

Changeset 7124d3e42bee made by Martin van Dinther martin.van.dinther@monetdbsolutions.com in the MonetDB repo, refers to this bug.

For complete details, see http//devmonetdborg/hg/MonetDB?cmd=changeset;node=7124d3e42bee

Changeset description:

Added test for Bug #3887

Comment 21672

Date: 2015-12-18 13:05:23 +0100
From: @njnes

fixed, ie return error when profiler isn't started jet.

Comment 21673

Date: 2015-12-18 13:07:17 +0100
From: MonetDB Mercurial Repository <>

Changeset 6a05428d4df7 made by Niels Nes niels@cwi.nl in the MonetDB repo, refers to this bug.

For complete details, see http//devmonetdborg/hg/MonetDB?cmd=changeset;node=6a05428d4df7

Changeset description:

fixed bug #3887, ie return error when profiler isn't started

handle over() again on query without where.