Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

textmodel_wordfish raises error for large dfm #482

Closed
cschwem2er opened this issue Jan 19, 2017 · 1 comment
Closed

textmodel_wordfish raises error for large dfm #482

cschwem2er opened this issue Jan 19, 2017 · 1 comment
Milestone

Comments

@cschwem2er
Copy link

Hi,

I have a dfm large 22.300x10.047 corpus, for which fitting a wordfish model raises the following error:

Error in wordfishcpp(as.matrix(data), as.integer(dir), 1/(priors^2), tol, : std::bad_alloc
3.
stop(structure(list(message = "std::bad_alloc", call = wordfishcpp(as.matrix(data), as.integer(dir), 1/(priors^2), tol, disp, dispersionFloor), cppstack = NULL), .Names = c("message", "call", "cppstack" ), class = c("std::bad_alloc", "C++Error", "error", "condition" ...
2.
wordfishcpp(as.matrix(data), as.integer(dir), 1/(priors^2), tol, disp, dispersionFloor)
1.
textmodel_wordfish(dfm14)

I checked the RAM of my PC during the function call and there were over 8GB left right before the error. Is this related to #124? Does wordfish still require a dense matrix?

@kbenoit
Copy link
Collaborator

kbenoit commented Jan 19, 2017

I think this is the same as #124. @HaiyanLW is working on this fix.

@kbenoit kbenoit modified the milestone: v1.0 Mar 16, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants