mserver5: gdk_bat.c:1015: setcolprops: Assertion `x != ((void *)0) || col->type == 0' failed.

[monetdb-team]

Date: 2015-11-20 01:20:47 +0100
From: @skinkie
To: SQL devs <>
Version: -- development
CC: @njnes

Last updated: 2016-01-15 11:38:17 +0100

Comment 21560

Date: 2015-11-20 01:20:47 +0100
From: @skinkie

mserver5: gdk_bat.c:1015: setcolprops: Assertion `x != ((void *)0) || col->type == 0' failed.

When trying to import a reasonably big dataset, I end up with the above error after the copy statement. The incident can be reproduced by loading the specific file.

Statement used:
copy 7624307 records into "sys"."xxx_2015_04" from '/mnt/storage1/tmp/xxx_2015_04.csv.gz' delimiters ';', '\n' null as '';

Comment 21561

Date: 2015-11-20 01:21:25 +0100
From: @skinkie

MonetDB 5 server v11.22.0 (64-bit, 64-bit oids, 128-bit integers)
This is an unreleased version
Copyright (c) 1993-July 2008 CWI
Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved
Visit http://www.monetdb.org/ for further information
Found 31.4GiB available memory, 8 available cpu cores
Libraries:
libpcre: 8.33 2013-05-28 (compiled with 8.33)
openssl: OpenSSL 1.0.2d 9 Jul 2015 (compiled with OpenSSL 1.0.2d 9 Jul 2015)
libxml2: 2.9.1 (compiled with 2.9.1)
Compiled by: skinkie@bigdata.openebs.nl (x86_64-unknown-linux-gnu)
Compilation: gcc -O3 -pipe -Werror -Wall -Wextra -W -Werror-implicit-function-declaration -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wformat=2 -Wno-format-nonliteral -Winit-self -Winvalid-pch -Wmissing-declarations -Wmissing-format-attribute -Wmissing-prototypes -Wold-style-definition -Wpacked -Wunknown-pragmas -Wvariadic-macros -fstack-protector-all -Wstack-protector -Wpacked-bitfield-compat -Wsync-nand -Wjump-misses-init -Wmissing-include-dirs -Wlogical-op -Wunreachable-code
Linking : /usr/x86_64-pc-linux-gnu/bin/ld -m elf_x86_64

Comment 21572

Date: 2015-11-22 17:17:55 +0100
From: @njnes

detect incorrect input earlier (ie preventing out of buffer writes)