-
Notifications
You must be signed in to change notification settings - Fork 4.4k
Documentation Update #1339
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Documentation Update #1339
Conversation
docs/Basic-Guide.md
Outdated
__Note:__ You can only perform training with an `Learning Brain`. | ||
To set up the environment for training, you will need specify which agents are contributing | ||
to the training and which Brain is being trained. You can only perform training with | ||
an `Learning Brain`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"a learning brain"
docs/Basic-Guide.md
Outdated
to the training and which Brain is being trained. You can only perform training with | ||
an `Learning Brain`. | ||
|
||
1. Assign the **3DBallLearning** to the agents you would like to train. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"Assign the 3DBallLearning brain..."
docs/Migrating.md
Outdated
__Note:__ You can pass the same brain to multiple agents in a scene by | ||
leveraging Unity's prefab system or look for all the agents in a scene | ||
using the search bar of the `Hierarchy` window with the word `Agent`. | ||
* We modified the way we do inference with ML-Agents. All previous `.bytes` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Replace with something like "We have changed the way ML-Agents models perform inference"
docs/Basic-Guide.md
Outdated
as TensorFlowSharp and CoreML. The models we ship with our examples and the models | ||
generated with our trainers use the TensorFlowSharp inference backend : | ||
They have a `.tf` extension. This means that you will not be able to use them | ||
without first installing the TensorflowSharp backend. You can find instructions |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it TensorFlowSharp or TensorflowSharp?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
TensorFlowSharp, thanks.
docs/Basic-Guide.md
Outdated
Unity settings first. You will also need to have appropriate inference backends | ||
installed in order to run your models inside of Unity. See [here](Inference-Engine.md) | ||
for more information. | ||
Unity settings first. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"some Unity settings first." --> "a few Unity settings:"
README.md
Outdated
our [documentation home](docs/Readme.md). | ||
* If you are a researcher interested in a discussion of Unity as an AI platform, see a pre-print of our [reference paper on Unity and the ML-Agents Toolkit](https://arxiv.org/abs/1809.02627). Also, see below for instructions on citing this paper. | ||
* If you have used a version of the ML-Agents toolkit prior to v0.6, we strongly | ||
* If you have used a prior version of the ML-Agents toolkit, we strongly |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"a prior" --> "an earlier"
docs/Basic-Guide.md
Outdated
|
||
In order to run pre-trained models of agents behaviors, you will need to set-up the | ||
[Inference Engine](Inference-Engine.md). The Inference Engine is a general API to | ||
run Neural Network models in Unity that leverages existing inference libraries such |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"Neural Network models" --> "neural network models (the kind generated by ML-Agents)"
docs/Basic-Guide.md
Outdated
In order to run pre-trained models of agents behaviors, you will need to set-up the | ||
[Inference Engine](Inference-Engine.md). The Inference Engine is a general API to | ||
run Neural Network models in Unity that leverages existing inference libraries such | ||
as TensorFlowSharp and CoreML. The models we ship with our examples and the models |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
CoreML --> Apple's Core ML
docs/Basic-Guide.md
Outdated
|
||
## Setting up the Inference Engine | ||
|
||
In order to run pre-trained models of agents behaviors, you will need to set-up the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We provide pre-trained models for all the agents in our all demo environments. To be able to run those models, you'll first need to set-up the Inference Engine.
docs/Basic-Guide.md
Outdated
[Inference Engine](Inference-Engine.md). The Inference Engine is a general API to | ||
run Neural Network models in Unity that leverages existing inference libraries such | ||
as TensorFlowSharp and CoreML. The models we ship with our examples and the models | ||
generated with our trainers use the TensorFlowSharp inference backend : |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The models we ship with our examples and the models generated with our trainers use the TensorFlowSharp inference backend : They have a .tf
extension. This means that you will not be able to use them
without first installing the TensorFlowSharp backend.
-->
Since the ML-Agents Toolkit uses TensorFlow for training neural network models, the output model format is TensorFlow and the model files include a .tf
extension. Consequently, you need to install the TensorFlowSharp backend to be able to run these models within the Unity Editor.
docs/Basic-Guide.md
Outdated
2. In the **Project** window, go to `Assets/ML-Agents/Examples/3DBall/Prefabs` folder | ||
and select the `Game/Platform` prefab. | ||
3. In the `Ball 3D Agent` Component: Drag the **3DBallLearning** located into | ||
3. In the `Ball 3D Agent` Component: Drag the **3DBallLearning** Brain located into |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Brain located into --> Brain located in
docs/Basic-Guide.md
Outdated
|
||
## Setting up the Inference Engine | ||
|
||
We provide pre-trained models for all the agents in our all demo environments. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
in our all demo -> in all of our demo
docs/Basic-Guide.md
Outdated
|
||
1. Assign the **3DBallLearning** to the agents you would like to train and the **3DBallPlayer** Brain to the agents you want to control manually. | ||
__Note:__ You can only perform training with an `Learning Brain`. | ||
To set up the environment for training, you will need specify which agents are contributing |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you will need specify -> you will need to specify
|
||
__Note:__ Assigning a Brain to an agent (dragging a Brain into the `Brain` property of | ||
the agent) means that the Brain will be making decision for that agent. Whereas dragging | ||
a Brain into the Broadcast Hub means that the Brain will be exposed to the Python process. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe change to:
Whereas dragging a Brain into the Broadcast Hub means that the Brain will be exposed to the Python process, and checking the Control toggle means the Brain will be exposed to the Python process and controlled by the Python process(so that the training happens).
docs/Migrating.md
Outdated
have now a `.tf` extension and use TensorflowSharp as a backend for the | ||
[Inference Engine](Inference-Engine.md). | ||
__Note:__ You will need to delete the previous TensorFlowSharp package | ||
and install the new one to do inference. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe add:
To correctly delete the previous TensorFlowSharp package, Delete all of the files under ML-Agents/Plugins folder except the files under ML-Agents/Plugins/ProtoBuffer.
docs/Migrating.md
Outdated
leveraging Unity's prefab system or look for all the agents in a scene | ||
using the search bar of the `Hierarchy` window with the word `Agent`. | ||
* To update a scene from v0.5 to v0.6, you must: | ||
* Remove the `Brain` GameObjects in the scene |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove the Brain
GameObjects in the scene -> Delete all of the Brain
GameObjects under Academy in the scene.
using the search bar of the `Hierarchy` window with the word `Agent`. | ||
* To update a scene from v0.5 to v0.6, you must: | ||
* Remove the `Brain` GameObjects in the scene | ||
* Create new `Brain` Scriptable Objects using `Assets -> Create -> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe change to:
Create new Brain
Scriptable Objects using Assets -> Create -> ML-Agents
for each type of the Brain you plan to use, and put the created files under a folder called Brains
within your project.
docs/Migrating.md
Outdated
* Edit their `Brain Parameters` to be the same as the parameters used | ||
in the `Brain` GameObjects | ||
* Agents have a `Brain` field in the Inspector, you need to drag the | ||
appropriate Brain asset in it. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Brain asset -> Brain
Scriptable Objects
Since you referred to them as Scriptable Objects before.
|
||
__Note:__ You can pass the same brain to multiple agents in a scene by | ||
leveraging Unity's prefab system or look for all the agents in a scene | ||
using the search bar of the `Hierarchy` window with the word `Agent`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The steps to do migration is still missing the steps to add new brain to the BroadCast Hub
, and drag the brain into the corresponding field.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also the steps to drag the .tf file into the LearningBrain asset is missing.
The steps to migrate from TensorFlowSharp to the Inference Engine are missing.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also add a note that all of the models need to be retrained, and the previous models no longer works.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also add a note that the model scope has been changed, and now each of the brain's checkpoint file lives within its own folder.
[Inference Engine](Inference-Engine.md). | ||
__Note:__ You will need to delete the previous TensorFlowSharp package | ||
and install the new one to do inference. | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also I think this section should be moved above the migration steps.
on how to install the TensorFlowSharp backend [here](Inference-Engine.md). | ||
Once the backend is installed, you will need to reimport the models : Right click | ||
on the `.tf` model and select `Reimport`. | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also to align with the format of the Basic Guide, the steps to use Inference Engine should be described within this page instead of in another page, so that our user has a place to go through all of the steps in one place.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In the ideal scenario maybe, but ML-Agents will not host any Inference Engine documentation. So we can only link to external docs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just like how we did things with Tensorflowsharp, we were not hosting TensorFlowSharp, but we put the docs on how to use TensorFlowSharp on our own github.
docs/Basic-Guide.md
Outdated
|
||
We provide pre-trained models for all the agents in all our demo environments. | ||
To be able to run those models, you'll first need to set-up the Inference | ||
Engine.The Inference Engine is a general API to |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Engine.The --> Engine. The
docs/Basic-Guide.md
Outdated
Unity settings first. You will also need to have appropriate inference backends | ||
installed in order to run your models inside of Unity. See [here](Inference-Engine.md) | ||
for more information. | ||
In order to use the ML-Agents toolkit within Unity, you need to change a few |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you need to change --> you first need to change
docs/Readme.md
Outdated
## Installation & Set-up | ||
|
||
* [Installation](Installation.md) | ||
## Installation & Set-up |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure why any of the changes in this file are necessary.
No description provided.