Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tval #14

Merged
merged 6 commits into from May 8, 2019
Merged

Tval #14

merged 6 commits into from May 8, 2019

Conversation

zsunberg
Copy link
Member

@zsunberg zsunberg commented May 8, 2019

I figured it should probably not be called terminal_value because it is never called on terminal states, haha.

@zsunberg zsunberg requested a review from lassepe May 8, 2019 21:37
@codecov-io
Copy link

codecov-io commented May 8, 2019

Codecov Report

Merging #14 into master will increase coverage by 0.23%.
The diff coverage is 81.81%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #14      +/-   ##
==========================================
+ Coverage   47.05%   47.29%   +0.23%     
==========================================
  Files          12       12              
  Lines         425      444      +19     
==========================================
+ Hits          200      210      +10     
- Misses        225      234       +9
Impacted Files Coverage Δ
src/ARDESPOT.jl 66.66% <ø> (ø) ⬆️
src/default_policy_sim.jl 56.09% <100%> (+4.81%) ⬆️
src/bounds.jl 33.33% <66.66%> (+3.92%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5629fc5...baaef84. Read the comment docs.

@coveralls
Copy link

Coverage Status

Coverage increased (+0.4%) to 47.43% when pulling baaef84 on tval into 5629fc5 on master.

Copy link
Member

@lassepe lassepe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. I just tested this with our use case again and it seems to do the job. I only get precision error gaps now which will be fixed by #12.

S = statetype(pomdp)
O = obstype(pomdp)
odict = Dict{O, Vector{Pair{Int, S}}}()

if steps <= 0
return 0.0
return length(b.scenarios)*fval(pomdp, b)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh I see ... the reward here must be the sum over all scenarios... 👍

@lassepe lassepe merged commit 6b7715e into master May 8, 2019
@lassepe lassepe deleted the tval branch May 8, 2019 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants