Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

prototype_sandag_crossborder is unstable #598

Open
jpn-- opened this issue Sep 6, 2022 · 0 comments
Open

prototype_sandag_crossborder is unstable #598

jpn-- opened this issue Sep 6, 2022 · 0 comments
Labels
Bug Something isn't working/bug f

Comments

@jpn--
Copy link
Member

jpn-- commented Sep 6, 2022

In the prototype_sandag_crossborder, the reproducibility is unstable dependent on the number of processes used for the run. The current model only has a single regression test case, running the model for 10 households in multiprocess mode with 2 processes. Changing the number of processes (e.g. from 2 to 3) or disabling multiprocessing (implicitly going from 2 to 1) changes the outcome of the model, causing the test to fail. The results are reproducible if the number of processes is held fixed at 2.

The design of ActivitySim is supposed to be stable over multiprocessing with any number of processes. We have tests for other models (e.g. see prototype_mtc or placeholder_sandag) that run the same regression test against both single and multi-process and get identical results.

@jpn-- jpn-- added the Bug Something isn't working/bug f label Sep 6, 2022
@jpn-- jpn-- changed the title prototype_sandag_crossborder reproducible random is unstable prototype_sandag_crossborder is unstable Sep 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working/bug f
Projects
None yet
Development

No branches or pull requests

1 participant