When I export data.table using fwrite, the size of the file is 31.3GB
then when I use gzip in order to compress the file, I get:
Error in writeBin(bfr, con = out, size = 1L) :
'Calloc' could not allocate memory (10000000 of 1 bytes)
Please don't post comments with simply "+1". This adds absolutely no value. Either write something of value that adds something to the discussion or use the thumbs up emoticon / reaction on the original post to express interest in the issue and a solution to it.
I'm in favor of deleting such comments, including mine BTW, because it is of no consequence to the technical discussion of this issue as writing "+1". Please, people, please ;)