Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[S-01] Single-step and Multi-goal tasks on Panda #3

Closed
2 tasks done
CUN-bjy opened this issue Aug 19, 2021 · 1 comment · Fixed by #9
Closed
2 tasks done

[S-01] Single-step and Multi-goal tasks on Panda #3

CUN-bjy opened this issue Aug 19, 2021 · 1 comment · Fixed by #9
Assignees
@CUN-bjy @benthebear93
Labels
exp experiments
Projects
project-sandwich-man
Milestone
Stage 1

Comments

@CUN-bjy
Copy link
Member

CUN-bjy commented Aug 19, 2021 •
edited
Loading

Experiments for single-step task on panda-gym

Describe some reports for the experiments below.

Results

  • PandaReach-v1, PandaPush-v1, PandaPickAndPlace-v1 -> converged well.
  • but PandaStack-v1 -> never converged w/ SAC+HER agent only.
@CUN-bjy CUN-bjy created this issue from a note in project-sandwich-man (To do) Aug 19, 2021
@CUN-bjy CUN-bjy moved this from To do to In progress in project-sandwich-man Aug 19, 2021
@CUN-bjy CUN-bjy added the exp experiments label Aug 19, 2021
@CUN-bjy
Copy link
Member Author

CUN-bjy commented Aug 20, 2021 •
edited
Loading

playing trained-agent from rl-baselines3-zoo

PandaReach-v1

Peek 2021-08-20 15-40

PandaPush-v1

Peek 2021-08-20 15-41

PandaPickAndPlace-v1

Peek 2021-08-20 15-42

PandaStack-v1

Peek 2021-08-20 15-43

(..!?)

@CUN-bjy CUN-bjy changed the title [1-1] Single-step Multi-goal tasks on Panda [PRJ-01-1] Single-step Multi-goal tasks on Panda Aug 20, 2021
@CUN-bjy CUN-bjy changed the title [PRJ-01-1] Single-step Multi-goal tasks on Panda [SWM-01-1] Single-step Multi-goal tasks on Panda Aug 20, 2021
@CUN-bjy CUN-bjy changed the title [SWM-01-1] Single-step Multi-goal tasks on Panda [SM-01-1] Single-step Multi-goal tasks on Panda Aug 20, 2021
@CUN-bjy CUN-bjy changed the title [SM-01-1] Single-step Multi-goal tasks on Panda [S-01-1] Single-step Multi-goal tasks on Panda Aug 20, 2021
@CUN-bjy CUN-bjy closed this as completed Aug 24, 2021
@CUN-bjy CUN-bjy moved this from In progress to Done in project-sandwich-man Aug 24, 2021
@CUN-bjy CUN-bjy changed the title [S-01-1] Single-step Multi-goal tasks on Panda [S-01] Single-step Multi-goal tasks on Panda Aug 24, 2021
@CUN-bjy CUN-bjy changed the title [S-01] Single-step Multi-goal tasks on Panda [S-01-1] Single-step and Multi-goal tasks on Panda Aug 24, 2021
@CUN-bjy CUN-bjy changed the title [S-01-1] Single-step and Multi-goal tasks on Panda [S-01] Single-step and Multi-goal tasks on Panda Aug 24, 2021
@CUN-bjy CUN-bjy linked a pull request Aug 26, 2021 that will close this issue
[feature] Add single-step trainer w/ sac+her agent #9
Merged
2 tasks
@CUN-bjy CUN-bjy moved this from Done to Stage 1 in project-sandwich-man Aug 28, 2021
@CUN-bjy CUN-bjy added this to the Stage 1 milestone Aug 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@CUN-bjy CUN-bjy

@benthebear93 benthebear93

Labels
exp experiments
Projects
project-sandwich-man
Stage 1
Milestone
Stage 1
Development

Successfully merging a pull request may close this issue.

[feature] Add single-step trainer w/ sac+her agent ropiens/project-sandwich-man
2 participants
@CUN-bjy @benthebear93