Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve parallelisation documentation and handling #181

Open
florianhartig opened this issue Apr 9, 2019 · 4 comments
Open

Improve parallelisation documentation and handling #181

florianhartig opened this issue Apr 9, 2019 · 4 comments

Comments

@florianhartig
Copy link
Owner

From the feedback that I'm getting, it seems that many people run into problems when going from serial to parallel settings. The problems vary, and are often generic R parallelisation problems that would have also occurred when trying a parApply, but still, I think it would be useful to go another time through our parallelisation handling and documentation, and see if things can be made easier for the user.

Subpoints of that (please add points):

@evodevosys
Copy link

evodevosys commented Jul 2, 2019

It would be helpful to have an example of coverting a non-parallel-compatible likelihood function to a parallel-compatible one. For example, the documentation just says it needs to be able to operate on a matrix of proposals but it isn't clear (to a novice) what this matrix looks like - what does entry A[i,j] represent vs. A[j,i]?

@florianhartig
Copy link
Owner Author

Thanks for the feedback. I just added a few remarks in the help of createBayesianSetup. You will have to install the development version to see this, but it's nothing major.

The matrix is explained in the help - a matrix with parameters as columns (and the different model runs as rows)

There is an example for an external parallelisation in the vignette.

That being said, I would only recommend this if parallel = T does not work for you!

@ashiklom
Copy link

ashiklom commented May 4, 2020

How would you feel about using future for parallelization? That will allow the user to control exactly which parallelization backend they would like to use (via environment variables or the plan function).

@florianhartig
Copy link
Owner Author

So, parallelisation is still confusing for users, see #249 - should improve documentation and UX. Will also consider future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants