human feedback in manual mode

[prestoj]

When in manual mode, you often see the agent get off track but are nonetheless hopeless as you can only say either "yes" and it does the wrong thing, or "no" and you have to start over. With my changes, you can tell the agent what it's doing wrong and what it should be doing instead.

human.feedback.mov

[amauryfischer]

Definitely a must-have feature !
Also could you add that in continuous mode ?

[Davayde]

Would be awesome if it could reach the goals you give it and spit out an answer, it seems to go on and on without reaching an end point

[slavakurilyak]

Please name this Active Mode and update the README file on usage

[DamascusGit]

getting lots of "failed to parse" errors here.

[tkaitchuck]

@prestoj I believe this is causing #626