Skip to content
This repository has been archived by the owner on Nov 15, 2021. It is now read-only.

Sync with ray master #33

Merged
merged 79 commits into from Jun 6, 2019
Merged

Sync with ray master #33

merged 79 commits into from Jun 6, 2019

Conversation

stefanpantic
Copy link

  • Sync with ray master

ericl and others added 30 commits May 10, 2019 20:36
* remove hard tf dep

* add test

* comment fix

* fix test
* Add a SWAP TaskQueue so that we can keep track of tasks that are temporarily dequeued

* Fix bug where tasks that fail to be forwarded don't appear to be local by adding them to SWAP queue

* cleanups

* updates

* updates
…n user thread. (ray-project#4798)

* Add WorkerUncaughtExceptionHandler

* Fix

* revert bazel and pom
* Update README.rst, index.rst, tutorial.rst and  _config.yml
Introduces a minimally invasive utility for logging experiment results. A broad requirement for this tool is that it should integrate seamlessly with Tune execution.
… support (ray-project#4795)

* dynamic graph

* wip

* clean up

* fix

* document trainer

* wip

* initialize the graph using a fake batch

* clean up dynamic init

* wip

* spelling

* use builder for ppo pol graph

* add ppo graph

* fix naming

* order

* docs

* set class name correctly

* add torch builder

* add custom model support in builder

* cleanup

* remove underscores

* fix py2 compat

* Update dynamic_tf_policy_graph.py

* Update tracking_dict.py

* wip

* rename

* debug level

* rename policy_graph -> policy in new classes

* fix test

* rename ppo tf policy

* port appo too

* forgot grads

* default policy optimizer

* make default config optional

* add config to optimizer

* use lr by default in optimizer

* update

* comments

* remove optimizer

* fix tuple actions support in dynamic tf graph
ray-project#4819)

This implements some of the renames proposed in ray-project#4813
We leave behind backwards-compatibility aliases for *PolicyGraph and SampleBatch.
robertnishihara and others added 25 commits May 29, 2019 16:57
* Add CallbackReply

* Fix

* fix linting by format.sh

* Fix linting

* Address comments.

* Fix
This string format is unnecessary. java_worker_options has been appended to the commandline later.
* wip

* add docs

* lint

* todo sections

* fix doc
…a_action_out_fn (ray-project#4894)

* fix torch extra out

* preserve setitem

* fix docs
Implements distributed SGD using distributed PyTorch.
…ured (ray-project#4880)

* disallow it

* import fix

* fix example

* fix test

* fix tests

* Update mock.py

* fix

* make less convoluted

* fix tests
@nikola-j
Copy link

nikola-j commented Jun 6, 2019

Add:

        [action], state_out, info, *_ = self.compute_actions(

@wingman-ai wingman-ai deleted a comment from stefanpantic Jun 6, 2019
@stefanpantic stefanpantic merged commit 62c0a9e into master Jun 6, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet