COPY BINARY INTO fails on 6gb file; works fine on 3gb #3513
Last updated: 2014-10-31 14:14:06 +0100
Date: 2014-07-15 09:49:41 +0200
User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.3; .NET4.0C; .NET4.0E)
I am testing tables with 800 million rows.
Steps to Reproduce:
Error message: "failed to attach file"
800000000 rows affected
Date: 2014-07-18 03:13:05 +0200
Created attachment 291
I4gb.i8 is a 4gb file;
I4ga.i8 is 8 bytes smaller, and COPY BINARY INTO works fine with it.
So 4gb is apparently the dividing line between files which work and
Date: 2014-07-18 03:15:55 +0200
I refined the bug description:
COPY BINARY INTO is a nice fast way to import data into MonetDB,
Date: 2014-08-05 08:45:55 +0200
seems to run just fine on linux, ie a windows related of build related bug.
Date: 2014-08-06 00:34:54 +0200
(In reply to comment 3)
Yes, the attachment I added on 2014-07-18 shows the mserver5.exe version:
The mclient.exe --version doesn't mention 64bit.
Thank you for testing this on linux.
Date: 2014-08-06 10:43:52 +0200
indeed we suspect the windows io interface.
Date: 2014-08-07 11:31:45 +0200
Confirmed for Jan2014-SP3 on Windows7 64 bits
sql>create table foo(i integer);
The last error message appeared immediately. File sizes:
Date: 2014-08-07 14:03:54 +0200
For complete details, see http//devmonetdborg/hg/MonetDB?cmd=changeset;node=1ae0470d6038
Date: 2014-08-11 17:33:55 +0200
Confirmed fixed in Jan2014 branch. You may try the test only build at http://monetdb.cwi.nl/testweb/web/52388:64939b9031c6/MonetDB5-SQL-Installer-x86_64-64939b9031c6.msi to confirm.
sql>copy binary into foo from ('c:\Users\hannes\1bnints');
Date: 2014-08-12 01:15:19 +0200
(In reply to comment 8)
Thanks - I confirmed that this fixes the problem.
It was very resourceful to think of trying the O_BINARY flag for this.
Date: 2014-10-31 14:14:06 +0100
Oct2014 has been released.
The text was updated successfully, but these errors were encountered: