Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Ranked Memory #1

Merged
merged 73 commits into from Jan 15, 2017
Merged

Implement Ranked Memory #1

merged 73 commits into from Jan 15, 2017

Conversation

kengz
Copy link
Owner

@kengz kengz commented Jan 2, 2017

Implement the Ranked Memory and test it.

@kengz
replace with sorted exp memory, reduced to normal linear memory on pu…
749c23a 
…re randon sampling
@kengz
found a better lefttail param value
6709a66
@kengz
separate ranked memory to better and worse halves for sampling minibatch
01fade1
@kengz
add package.json for better top level control using npm
1c0c10d
@kengz
update posttest npm script
c97bedb
@kengz
update npm run clear command to clear pycache
b8c049b
@kengz
update exp data naming to remove reserved chars
45cde48
@kengz
fix tf delete_status bug using keras.clear_session() instead of gc
b941499
@kengz
Merge remote-tracking branch 'origin/master' into ranked-memory
33378b5
@kengz
move experiment logic out of session, standardize timestamp in util
4fe4caa
@kengz
complete first experiment modularized setup run
0b53aa9
@kengz
implement own json serializer cuz fuck python
3e4928c
@kengz
reconstruct experiment into class object
bc2d81a
@kengz
fix tests
b7d319b
@kengz
decide on graphing design - absorb into part of Experiment. add descr…
5108729 
…iption, ready for implementation
@kengz
merge session.py into experiment.py
1645e92
@kengz
rewrite session init to use self properties throughout
f4c92c1
@kengz
update session to include own plotter; prepare to absorb update_histo…
d53db17 
…ry and check_session_end into session
@kengz
absorb plotter functions into session
048d62c
@kengz
move final data and graph update logic into Session
bb4b139
@kengz
rename Session self.figure
fb5edca
@kengz
modularize plot methods into Grapher class
db920d5
@kengz
move graph save into grapher
1de3c4b
@kengz
use Experiment to init Session, implement file name inherited from Ex…
514bc40 
…p, timestamped at start
@kengz
add env close for cleanup in consecutive runs
1f45c55
@kengz
reorganize experiment data saving
e1d43bf
@kengz
close specific figure when done
547bd6e
@kengz
fix sys_vars copy bug; cancel removal of figure on save
5b929ef
@kengz
fix bug by resetting sys_vars total_rewards back to 0 at epi start
d79ef62
@kengz
fix K.clear_session not found when using theano, by adding K._BACKEND…
0a23e08 
… checker
@kengz
update param_range for dqn to be more sensible
d24392c
@kengz
enable graphing even in parallel mode now
2ed945b
@kengz
suppress matplotlib warning to stdout
e5c8dcf
@kengz
add log_delimiter
20b4a24
@kengz
improve logger
c63acbb
@kengz
fix tests
496de71
@kengz
add summary metrics with basic stats
b195f28
@kengz
readjust dqn param range
cf2a3fb
@kengz
RENDER flag applies only to gym render; graphing always trigger excep…
b2deab1 
…t on CI
@kengz
add more timing stats
4b1ddd7
@kengz
reduce the max episodes for simple problems for quick solutions
1c18b12
@kengz
correct mean_rewards stats, add total_rewards stats, rename total_rew…
1c7a032 
…ards_history
@kengz
bump lunar lander max epis to 600
b391e1c
@kengz
use explicit index variable
55e7acb
@kengz
add progress log
d50c23c
@kengz
refactor sess_spec_grid constructor
4de7d4c
@kengz
add tee to save terminal log from npm run
ffc4a06
@kengz
add pandas requirement to prepare for data analysis
5264edc
@kengz
add experiment_id to data file
9e0f999
@kengz
add a core dev sess_spec
99be88f
@kengz
update example call in main.py for dev
33751a1
@kengz
remove unused deps
d50bf59
@kengz
implement analyze_param_space by prefix_id to rank experiments
604eedf
@kengz
add csv to clear
6600056
@kengz
fix tests
710c321
@kengz
merge from master on experiment rework
5695455
@kengz
Copy link
Owner Author

kengz commented Jan 15, 2017

Reviewed in person with Laura. Safe to merge. (maybe)

@kengz kengz merged commit 5094ac2 into master Jan 15, 2017
@kengz kengz deleted the ranked-memory branch January 16, 2017 04:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@kengz