require(data.table)
system.time(ans<- fread("~/Downloads/example.csv"))
# Read 374058 rows x 4 columns from 0.580GB file in 00:01.874 wall clock time (can be slowed down by any other open apps even if seemingly idle)# Error in fread("example.csv") : # Jump 12 did not end exactly where jump 13 found its first good line start. end(0x10b4f26ef)<<"3","8","7","2013/11/18 18:18:03">> != start(prev+35)<<"3","8","7","2013/11/18 18:19:02">># Timing stopped at: 4.473 0.247 1.879
This file was working fine a couple of commits ago but was thrice as slow (10s on CRAN version vs 32s on 4 threads). And now it errors.
Aside: also note that the columns are all read as character, even though the first three columns could/should be integers. But this happens even on CRAN version. I haven't had to time to check why this happens.
The text was updated successfully, but these errors were encountered:
Here's the link to zipped version of file (50MB, unzips to ~620MB).
with
verbose=TRUE
:This file was working fine a couple of commits ago but was thrice as slow (10s on CRAN version vs 32s on 4 threads). And now it errors.
Aside: also note that the columns are all read as character, even though the first three columns could/should be integers. But this happens even on CRAN version. I haven't had to time to check why this happens.
The text was updated successfully, but these errors were encountered: