New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parametric/exact Rmin: wrong result #15
Labels
Comments
kleinj
added a commit
to kleinj/prism-svn
that referenced
this issue
Aug 15, 2017
…olicy iteration To ensure that the policy iteration (performed on an MDP where parameters have been replaced by a parameter valuation) converges and converges on the right result, we initialise the policy iteration for Rmin[F] with a proper scheduler, i.e., that reaches the goal with probability one (see [BertsekasTsitsiklis91]). Together with the previous commit, this fixes issue prismmodelchecker/prism#15. As there is no check against negative rewards, those remain problematic.
kleinj
added a commit
to kleinj/prism
that referenced
this issue
Aug 28, 2017
…olicy iteration To ensure that the policy iteration (performed on an MDP where parameters have been replaced by a parameter valuation) converges and converges on the right result in the presence of zero-reward end components, we initialise the policy iteration for Rmin[F] with a proper scheduler, i.e., that reaches the goal with probability one (see [BertsekasTsitsiklis91]). Together with the previous commit, this fixes prismmodelchecker#4 and prismmodelchecker#15.
davexparker
pushed a commit
that referenced
this issue
Aug 31, 2017
…olicy iteration To ensure that the policy iteration (performed on an MDP where parameters have been replaced by a parameter valuation) converges and converges on the right result in the presence of zero-reward end components, we initialise the policy iteration for Rmin[F] with a proper scheduler, i.e., that reaches the goal with probability one (see [BertsekasTsitsiklis91]). Together with the previous commit, this fixes #4 and #15.
Fixed by the commit referenced above, now merged. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
At https://groups.google.com/d/topic/prismmodelchecker/vQI-1srXSdk/discussion, Shalini Ghosh reported a small MDP with a strange result for an Rmin formula in the parametric engine. The model is attached.
The problematic formula is
Rmin=?[ F "changed" ]
.Manually restricting the MDP to the minimal strategy DTMC yields the expected results:
Some preliminary debugging suggests that the precomputation for Rmin in the parametric/exact engine is the most probable culprit.
lanechange_mdp.prism.txt
lanechange_dtmc.prism.txt
The text was updated successfully, but these errors were encountered: