Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.
Sign upsetDT error when list is too big #3121
Milestone
Comments
This comment has been minimized.
This comment has been minimized.
look at table(lengths(w1M)) |
This comment has been minimized.
This comment has been minimized.
`> table(lengths(w1M))
998543 1365 87 4 1 ` thanks! and I wonder why I ended up with elements with length other than 3. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
First I created a list of 100 elements with each element containing 3 words:
`> w100 <- topfeat_first10M[1:100]
then I converted this list using setDT. It returned a dt with 3 columns which was exactly what I wanted:
`> w100DT <- transpose(setDT(w100))
Next, I created a list with 1million elements and ran the same instruction, but I got this:
`> w1M <- topfeat_first10M[1:1000000]
What's happening? Memory issue? Anyway to get around it?