/Absolute/Path/To/Grounding_LLMs_with_online_RL/lamorel/lamorel/src/lamorel_launcher/launch.py:15: UserWarning: 
The version_base parameter is not specified.
Please specify a compatability version level, or None.
Will assume defaults for version 1.1
  @hydra.main(config_path='', config_name='')
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/hydra/_internal/hydra.py:119: UserWarning: Future Hydra versions will no longer change working directory at job runtime by default.
See https://hydra.cc/docs/1.2/upgrades/1.1_to_1.2/changes_to_job_working_dir/ for more information.
  ret = run_job(
[2024-06-27 15:48:15,174][root][INFO] - Using nproc_per_node=1.
/Absolute/Path/To/Grounding_LLMs_with_online_RL/experiments/train_language_agent.py:373: UserWarning: 
The version_base parameter is not specified.
Please specify a compatability version level, or None.
Will assume defaults for version 1.1
  @hydra.main(config_path='config', config_name='config')
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/hydra/_internal/hydra.py:119: UserWarning: Future Hydra versions will no longer change working directory at job runtime by default.
See https://hydra.cc/docs/1.2/upgrades/1.1_to_1.2/changes_to_job_working_dir/ for more information.
  ret = run_job(
[2024-06-27 15:48:18,915][lamorel_logger][INFO] - Successfully initialized distributed process on process 0
[2024-06-27 15:48:18,916][lamorel_logger][INFO] - Init rl group for process 0
[2024-06-27 15:48:18,918][lamorel_logger][INFO] - Init llm group for process 0
[2024-06-27 15:48:18,918][lamorel_logger][INFO] - Init rl-llm group for process 0
[2024-06-27 15:48:20,364][root][INFO] - resetting environment
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:165: UserWarning: WARN: The obs returned by the `reset()` method is not within the observation space.
  logger.warn(f"{pre} is not within the observation space.")
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:133: UserWarning: WARN: The obs returned by the `reset()` method should be an int or np.int64, actual type: <class 'str'>
  logger.warn(f"{pre} should be an int or np.int64, actual type: {type(obs)}")
[2024-06-27 15:48:20,387][root][INFO] - reset environment

  0%|                                                                        | 0/40 [00:00<?, ?it/s]/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:219: DeprecationWarning: WARN: Core environment is written in old step API which returns one bool instead of two. It is recommended to rewrite the environment with new step API. 
  logger.deprecation(
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:225: DeprecationWarning: `np.bool8` is a deprecated alias for `np.bool_`.  (Deprecated NumPy 1.24)
  if not isinstance(done, (bool, np.bool8)):
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:165: UserWarning: WARN: The obs returned by the `step()` method is not within the observation space.
  logger.warn(f"{pre} is not within the observation space.")
/Absolute/Path/To/miniconda3/envs/dlp/lib/python3.10/site-packages/gym/utils/passive_env_checker.py:133: UserWarning: WARN: The obs returned by the `step()` method should be an int or np.int64, actual type: <class 'str'>
  logger.warn(f"{pre} should be an int or np.int64, actual type: {type(obs)}")

  2%|>                                                               | 1/40 [00:00<00:20,  1.92it/s]
  5%|>>>                                                             | 2/40 [00:01<00:35,  1.06it/s]
  8%|>>>>                                                            | 3/40 [00:02<00:35,  1.05it/s]
 10%|>>>>>>                                                          | 4/40 [00:03<00:33,  1.06it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:04<00:31,  1.11it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:05<00:30,  1.13it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:06<00:29,  1.13it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:07<00:28,  1.14it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:08<00:29,  1.05it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:09<00:27,  1.07it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:09<00:26,  1.09it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:10<00:25,  1.09it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:11<00:23,  1.13it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:12<00:22,  1.16it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:13<00:21,  1.15it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:14<00:21,  1.12it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:15<00:20,  1.14it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:16<00:19,  1.14it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:17<00:21,  1.03s/it]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:18<00:20,  1.03s/it]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:19<00:19,  1.05s/it]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:20<00:17,  1.00it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:22<00:20,  1.21s/it]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:23<00:17,  1.11s/it]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:23<00:15,  1.05s/it]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:24<00:14,  1.00s/it]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:25<00:12,  1.04it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:26<00:11,  1.06it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:27<00:10,  1.07it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:29<00:11,  1.17s/it]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:30<00:11,  1.31s/it]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:31<00:09,  1.18s/it]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:32<00:07,  1.09s/it]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:33<00:06,  1.03s/it]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:34<00:04,  1.01it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:35<00:03,  1.03it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:36<00:02,  1.05it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:37<00:01,  1.07it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:38<00:00,  1.08it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:38<00:00,  1.08it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:38<00:00,  1.03it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                | 1/4 [01:56<05:50, 116.83s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [03:06<02:57, 88.92s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [04:15<01:19, 79.84s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:23<00:00, 75.30s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:23<00:00, 80.90s/it]
[2024-06-27 15:54:23,470][__main__][INFO] - 
Update: 1 | Episodes Done: 0 | Frames Seen: 000080 | FPS: 0000 | Ellapsed: 363                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 0.0 +- 0.0  (Min: 0, Max 0)                               
Entropy:  0.526 | Policy Loss:  0.007 | Value Loss:  0.00001 | Loss:  0.002 | Grad Norm:  0.139

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:20,  1.95it/s]
  5%|>>>                                                             | 2/40 [00:01<00:19,  1.96it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:18,  1.96it/s]
 10%|>>>>>>                                                          | 4/40 [00:02<00:18,  1.96it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:17,  1.96it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:03<00:16,  2.04it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:14,  2.20it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:15,  2.09it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:15,  2.02it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:14,  2.07it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:05<00:13,  2.20it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:11,  2.38it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:06<00:11,  2.45it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:10,  2.40it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:10,  2.46it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:07<00:09,  2.59it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:08,  2.60it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:08,  2.50it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:08,  2.44it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:07,  2.57it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:07,  2.67it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:06,  2.74it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:09<00:06,  2.79it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:10<00:05,  2.83it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:10<00:05,  2.86it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:10<00:04,  2.89it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:11<00:04,  2.72it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:11<00:04,  2.57it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:12<00:04,  2.55it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:12<00:03,  2.65it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:12<00:03,  2.76it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:13<00:02,  2.85it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:13<00:02,  2.83it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:13<00:02,  2.65it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:14<00:01,  2.51it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:14<00:01,  2.36it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:15<00:01,  2.31it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:15<00:00,  2.37it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.44it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:16<00:00,  2.42it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:16<00:00,  2.43it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:15<03:47, 75.67s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:22<02:20, 70.22s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:27<01:07, 67.89s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:36<00:00, 68.46s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:36<00:00, 69.13s/it]
[2024-06-27 15:59:16,713][__main__][INFO] - 
Update: 2 | Episodes Done: 1 | Frames Seen: 000160 | FPS: 0000 | Ellapsed: 656                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 32.0 +- 32.0  (Min: 0.0, Max 64.0)                               
Entropy:  0.695 | Policy Loss:  0.014 | Value Loss:  0.00023 | Loss:  0.007 | Grad Norm:  0.230

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:18,  2.10it/s]
  5%|>>>                                                             | 2/40 [00:00<00:17,  2.16it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:16,  2.31it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:14,  2.51it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:13,  2.59it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:13,  2.56it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:02<00:13,  2.43it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:13,  2.38it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:03<00:13,  2.38it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:12,  2.49it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:11,  2.53it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:04<00:11,  2.48it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:11,  2.42it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:05<00:10,  2.44it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:10,  2.49it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:06<00:09,  2.43it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:10,  2.27it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:10,  2.17it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:09,  2.11it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:09,  2.07it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:08,  2.11it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:08,  2.24it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:09<00:07,  2.28it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:10<00:07,  2.28it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:10<00:06,  2.17it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:11<00:06,  2.10it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:11<00:06,  2.14it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:12<00:05,  2.15it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:12<00:05,  2.18it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:13<00:04,  2.21it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:13<00:04,  2.21it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:13<00:03,  2.33it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:14<00:02,  2.34it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:14<00:02,  2.32it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:15<00:02,  2.31it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.28it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:16<00:01,  2.38it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.44it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.42it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.37it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.31it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:13<03:39, 73.12s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:19<02:18, 69.25s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:26<01:08, 68.21s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:30<00:00, 66.48s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:30<00:00, 67.61s/it]
[2024-06-27 16:04:04,693][__main__][INFO] - 
Update: 3 | Episodes Done: 1 | Frames Seen: 000240 | FPS: 0000 | Ellapsed: 944                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 32.0 +- 32.0  (Min: 0.0, Max 64.0)                               
Entropy:  0.787 | Policy Loss:  0.003 | Value Loss:  0.00000 | Loss: -0.005 | Grad Norm:  0.135

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:15,  2.45it/s]
  5%|>>>                                                             | 2/40 [00:00<00:14,  2.56it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:15,  2.47it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:15,  2.30it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:15,  2.26it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:15,  2.15it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:15,  2.08it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:16,  2.00it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:03<00:13,  2.32it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:12,  2.34it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:13,  2.13it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:12,  2.22it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:12,  2.24it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:11,  2.26it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:10,  2.39it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:06<00:09,  2.48it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:09,  2.43it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:09,  2.38it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:09,  2.28it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:09,  2.07it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:10,  1.84it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:10<00:10,  1.70it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:10<00:10,  1.67it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:11<00:08,  1.79it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:11<00:07,  1.92it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:12<00:06,  2.02it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:12<00:06,  1.99it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:13<00:06,  1.92it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:13<00:05,  1.93it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:14<00:05,  1.95it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:14<00:04,  1.95it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:15<00:04,  1.96it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:15<00:03,  2.08it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:16<00:02,  2.23it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:16<00:02,  2.25it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:17<00:01,  2.19it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:17<00:01,  2.02it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:18<00:01,  1.82it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:19<00:00,  1.69it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:19<00:00,  1.62it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:19<00:00,  2.03it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:30<04:31, 90.49s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:56<02:55, 87.75s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [04:21<01:26, 86.45s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:47<00:00, 86.34s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:47<00:00, 86.85s/it]
[2024-06-27 16:10:12,210][__main__][INFO] - 
Update: 4 | Episodes Done: 3 | Frames Seen: 000320 | FPS: 0000 | Ellapsed: 1311                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 96.0 +- 32.0  (Min: 64.0, Max 128.0)                               
Entropy:  0.765 | Policy Loss:  0.005 | Value Loss:  0.00004 | Loss: -0.003 | Grad Norm:  0.161

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:26,  1.47it/s]
  5%|>>>                                                             | 2/40 [00:01<00:25,  1.47it/s]
  8%|>>>>                                                            | 3/40 [00:02<00:25,  1.47it/s]
 10%|>>>>>>                                                          | 4/40 [00:02<00:23,  1.52it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:03<00:20,  1.70it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:03<00:17,  1.94it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:16,  2.05it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:04<00:15,  2.00it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:05<00:16,  1.93it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:05<00:15,  1.94it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:06<00:14,  1.95it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:06<00:14,  1.96it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:07<00:13,  1.97it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:07<00:13,  1.97it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:08<00:12,  1.97it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:08<00:12,  1.97it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:09<00:11,  1.97it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:09<00:11,  1.97it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:10<00:10,  2.06it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:10<00:08,  2.23it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:10<00:08,  2.36it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:11<00:07,  2.34it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:11<00:07,  2.33it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:11<00:06,  2.44it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:12<00:05,  2.67it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:12<00:05,  2.70it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:13<00:05,  2.56it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:13<00:04,  2.49it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:13<00:04,  2.56it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:14<00:03,  2.77it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:14<00:03,  2.77it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:14<00:03,  2.60it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:15<00:02,  2.96it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:15<00:01,  3.26it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:15<00:01,  3.15it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:16<00:01,  2.90it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:16<00:01,  2.50it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:17<00:00,  2.25it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:17<00:00,  2.08it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:18<00:00,  1.97it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:18<00:00,  2.18it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:27<04:23, 87.89s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:48<02:46, 83.47s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [04:03<01:19, 79.91s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:28<00:00, 81.71s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:28<00:00, 82.10s/it]
[2024-06-27 16:15:59,328][__main__][INFO] - 
Update: 5 | Episodes Done: 4 | Frames Seen: 000400 | FPS: 0000 | Ellapsed: 1658                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 64.0 +- 0.0  (Min: 64.0, Max 64.0)                               
Entropy:  0.789 | Policy Loss:  0.004 | Value Loss:  0.00001 | Loss: -0.004 | Grad Norm:  0.120

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:23,  1.65it/s]
  5%|>>>                                                             | 2/40 [00:01<00:21,  1.79it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:20,  1.78it/s]
 10%|>>>>>>                                                          | 4/40 [00:02<00:19,  1.85it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:17,  2.02it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:15,  2.20it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:14,  2.23it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:15,  2.11it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:14,  2.12it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:12,  2.35it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:10,  2.71it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:09,  3.03it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:08,  3.31it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:05<00:07,  3.53it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:05<00:06,  3.70it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:06<00:06,  3.82it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:06<00:05,  3.92it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:06<00:05,  3.99it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:06<00:05,  4.04it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:07<00:04,  4.08it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:07<00:04,  3.88it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:07<00:05,  3.23it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:08<00:06,  2.55it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:09<00:07,  2.09it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:09<00:07,  1.92it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:10<00:07,  1.87it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:10<00:06,  2.01it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:11<00:05,  2.25it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:11<00:04,  2.61it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:11<00:03,  2.94it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:11<00:03,  2.98it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:12<00:02,  2.79it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:12<00:02,  2.49it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:13<00:02,  2.31it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:13<00:02,  2.20it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:14<00:01,  2.10it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:14<00:01,  2.13it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:15<00:00,  2.26it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:15<00:00,  2.55it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:15<00:00,  2.84it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:15<00:00,  2.55it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:24<04:12, 84.06s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:40<02:38, 79.48s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:59<01:19, 79.12s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:17<00:00, 79.03s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:17<00:00, 79.48s/it]
[2024-06-27 16:21:33,052][__main__][INFO] - 
Update: 6 | Episodes Done: 4 | Frames Seen: 000480 | FPS: 0000 | Ellapsed: 1992                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 64.0 +- 0.0  (Min: 64.0, Max 64.0)                               
Entropy:  0.806 | Policy Loss:  0.001 | Value Loss:  0.00000 | Loss: -0.007 | Grad Norm:  0.158

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:09,  4.16it/s]
  5%|>>>                                                             | 2/40 [00:00<00:09,  4.17it/s]
  8%|>>>>                                                            | 3/40 [00:00<00:08,  4.17it/s]
 10%|>>>>>>                                                          | 4/40 [00:00<00:08,  4.17it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:01<00:08,  3.90it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:01<00:09,  3.53it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:02<00:11,  2.87it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:02<00:12,  2.46it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:03<00:14,  2.20it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:03<00:14,  2.13it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:13,  2.08it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:04<00:12,  2.18it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:04<00:11,  2.40it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:05<00:09,  2.75it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:05<00:08,  3.06it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:05<00:07,  3.23it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:05<00:06,  3.41it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:06<00:07,  2.99it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:06<00:08,  2.51it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:07<00:08,  2.38it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:07<00:08,  2.30it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:08<00:07,  2.31it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:08<00:07,  2.25it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:09<00:07,  2.16it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:09<00:07,  2.10it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:10<00:06,  2.09it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:10<00:06,  2.09it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:11<00:05,  2.00it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:11<00:05,  2.11it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:12<00:04,  2.09it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:12<00:04,  2.08it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:13<00:04,  1.91it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:13<00:03,  1.81it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:14<00:03,  1.74it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:14<00:02,  1.82it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.02it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:15<00:01,  2.16it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.21it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.19it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.12it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.33it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:20<04:02, 80.73s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:34<02:32, 76.35s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:52<01:17, 77.23s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:07<00:00, 76.42s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:07<00:00, 76.87s/it]
[2024-06-27 16:26:57,958][__main__][INFO] - 
Update: 7 | Episodes Done: 6 | Frames Seen: 000560 | FPS: 0000 | Ellapsed: 2317                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 96.0 +- 32.0  (Min: 64.0, Max 128.0)                               
Entropy:  0.953 | Policy Loss:  0.001 | Value Loss:  0.00000 | Loss: -0.008 | Grad Norm:  0.089

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:19,  1.98it/s]
  5%|>>>                                                             | 2/40 [00:01<00:19,  1.95it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:18,  1.96it/s]
 10%|>>>>>>                                                          | 4/40 [00:02<00:18,  1.96it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:17,  1.96it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:03<00:17,  2.00it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:17,  1.94it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:04<00:16,  1.97it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:15,  2.05it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:13,  2.16it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:05<00:12,  2.26it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:12,  2.31it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:06<00:11,  2.43it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:10,  2.54it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:09,  2.58it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:07<00:09,  2.58it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:09,  2.50it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:08<00:09,  2.25it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:09,  2.15it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:09<00:09,  2.12it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:08,  2.12it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:10<00:08,  2.15it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:10<00:07,  2.17it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:11<00:07,  2.19it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:11<00:06,  2.20it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:11<00:06,  2.27it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:12<00:05,  2.22it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:12<00:05,  2.27it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:13<00:04,  2.29it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:13<00:04,  2.27it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:14<00:03,  2.29it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:14<00:03,  2.40it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:14<00:02,  2.54it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:15<00:02,  2.62it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:15<00:01,  2.64it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.54it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:16<00:01,  2.43it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.33it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:17<00:00,  2.26it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.11it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.24it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:13<03:39, 73.16s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:21<02:20, 70.48s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:29<01:09, 69.33s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:38<00:00, 68.93s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:38<00:00, 69.51s/it]
[2024-06-27 16:31:54,092][__main__][INFO] - 
Update: 8 | Episodes Done: 7 | Frames Seen: 000640 | FPS: 0000 | Ellapsed: 2613                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 64.0 +- 0.0  (Min: 64.0, Max 64.0)                               
Entropy:  0.916 | Policy Loss:  0.000 | Value Loss:  0.00000 | Loss: -0.009 | Grad Norm:  0.082

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:15,  2.55it/s]
  5%|>>>                                                             | 2/40 [00:00<00:14,  2.64it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:14,  2.50it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:15,  2.38it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:15,  2.28it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:15,  2.17it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:15,  2.10it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:15,  2.09it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:14,  2.16it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:13,  2.30it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:12,  2.41it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:11,  2.42it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:11,  2.36it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:10,  2.39it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:10,  2.44it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:06<00:09,  2.51it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:09,  2.53it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:08,  2.47it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:08,  2.39it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:08,  2.37it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:08<00:07,  2.46it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:06,  2.59it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:09<00:06,  2.65it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:09<00:05,  2.67it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:10<00:05,  2.56it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:10<00:05,  2.42it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:11<00:05,  2.26it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:11<00:05,  2.17it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:12<00:05,  2.11it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:12<00:04,  2.07it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:13<00:04,  2.06it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:13<00:03,  2.09it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:14<00:03,  2.19it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:14<00:02,  2.32it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:14<00:02,  2.49it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.57it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:15<00:01,  2.54it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.40it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.29it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.30it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.35it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:12<03:36, 72.28s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:17<02:16, 68.19s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:23<01:06, 66.98s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:26<00:00, 65.71s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:26<00:00, 66.73s/it]
[2024-06-27 16:36:38,270][__main__][INFO] - 
Update: 9 | Episodes Done: 7 | Frames Seen: 000720 | FPS: 0000 | Ellapsed: 2897                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 64.0 +- 0.0  (Min: 64.0, Max 64.0)                               
Entropy:  0.999 | Policy Loss:  0.000 | Value Loss:  0.00000 | Loss: -0.010 | Grad Norm:  0.118

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:14,  2.64it/s]
  5%|>>>                                                             | 2/40 [00:00<00:13,  2.82it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:13,  2.81it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:13,  2.65it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:01<00:14,  2.44it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:14,  2.29it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:02<00:14,  2.24it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:14,  2.24it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:03<00:13,  2.30it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:12,  2.41it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:11,  2.52it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:04<00:10,  2.57it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:10,  2.49it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:05<00:10,  2.40it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:10,  2.37it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:06<00:09,  2.45it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:06<00:09,  2.54it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:08,  2.51it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:07<00:08,  2.38it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:08,  2.24it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:08<00:08,  2.14it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:08,  2.09it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:09<00:08,  2.05it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:10<00:07,  2.01it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:10<00:05,  2.55it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:10<00:04,  3.02it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:10<00:03,  3.31it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:11<00:03,  3.55it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:11<00:03,  3.42it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:11<00:03,  3.18it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:12<00:03,  2.97it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:12<00:02,  3.01it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:12<00:02,  3.13it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:13<00:02,  2.86it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:13<00:02,  2.49it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:14<00:01,  2.26it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:14<00:01,  2.24it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:15<00:00,  2.23it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:15<00:00,  2.22it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:16<00:00,  2.27it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:16<00:00,  2.49it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:15<03:45, 75.28s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:22<02:21, 70.70s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:30<01:09, 69.46s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:35<00:00, 67.43s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:35<00:00, 68.77s/it]
[2024-06-27 16:41:29,720][__main__][INFO] - 
Update: 10 | Episodes Done: 9 | Frames Seen: 000800 | FPS: 0000 | Ellapsed: 3189                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 96.0 +- 32.0  (Min: 64.0, Max 128.0)                               
Entropy:  1.139 | Policy Loss:  0.000 | Value Loss:  0.00000 | Loss: -0.011 | Grad Norm:  0.097

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:19,  2.04it/s]
  5%|>>>                                                             | 2/40 [00:00<00:18,  2.04it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:16,  2.19it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:16,  2.23it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:16,  2.13it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:14,  2.29it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:14,  2.32it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:14,  2.22it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:14,  2.16it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:14,  2.10it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:05<00:13,  2.13it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:12,  2.27it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:11,  2.44it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:10,  2.57it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:09,  2.51it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:07<00:10,  2.34it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:10,  2.24it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:07<00:09,  2.28it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:08,  2.43it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:08,  2.42it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:08,  2.34it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:08,  2.23it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:10<00:07,  2.21it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:10<00:07,  2.25it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:10<00:06,  2.34it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:11<00:05,  2.47it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:11<00:05,  2.57it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:12<00:04,  2.65it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:12<00:04,  2.70it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:12<00:03,  2.74it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:13<00:03,  2.69it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:13<00:03,  2.62it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:13<00:02,  2.59it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:14<00:02,  2.50it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:14<00:02,  2.36it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.32it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:15<00:01,  2.30it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.22it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.06it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.00it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.31it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:13<03:41, 73.94s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:21<02:20, 70.34s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:28<01:08, 68.68s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:32<00:00, 66.92s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:32<00:00, 68.17s/it]
[2024-06-27 16:46:20,010][__main__][INFO] - 
Update: 11 | Episodes Done: 9 | Frames Seen: 000880 | FPS: 0000 | Ellapsed: 3479                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 96.0 +- 32.0  (Min: 64.0, Max 128.0)                               
Entropy:  1.240 | Policy Loss:  0.000 | Value Loss:  0.00000 | Loss: -0.012 | Grad Norm:  0.125

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:19,  1.96it/s]
  5%|>>>                                                             | 2/40 [00:00<00:17,  2.12it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:15,  2.33it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:14,  2.52it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:14,  2.36it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:16,  2.12it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:15,  2.11it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:15,  2.10it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:04<00:14,  2.13it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:13,  2.16it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:05<00:13,  2.15it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:13,  2.03it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:06<00:13,  2.01it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:12,  2.08it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:11,  2.20it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:07<00:10,  2.21it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:11,  2.07it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:08<00:10,  2.03it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:09,  2.11it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:09<00:09,  2.18it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:08,  2.17it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:10<00:08,  2.10it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:10<00:07,  2.23it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:11<00:06,  2.41it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:11<00:05,  2.68it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:11<00:04,  2.85it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:12<00:04,  2.72it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:12<00:04,  2.43it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:13<00:05,  2.12it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:13<00:04,  2.02it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:14<00:04,  2.00it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:14<00:03,  2.14it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:14<00:02,  2.34it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:15<00:02,  2.62it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:15<00:01,  2.80it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.68it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:16<00:01,  2.40it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.18it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:17<00:00,  2.11it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.22it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.24it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:19<03:58, 79.50s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:31<02:30, 75.13s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [03:44<01:14, 74.30s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:57<00:00, 73.54s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [04:57<00:00, 74.32s/it]
[2024-06-27 16:51:35,358][__main__][INFO] - 
Update: 12 | Episodes Done: 10 | Frames Seen: 000960 | FPS: 0000 | Ellapsed: 3794                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 64.0 +- 0.0  (Min: 64.0, Max 64.0)                               
Entropy:  1.304 | Policy Loss: -0.000 | Value Loss:  0.00000 | Loss: -0.013 | Grad Norm:  0.087

  0%|                                                                        | 0/40 [00:00<?, ?it/s]
  2%|>                                                               | 1/40 [00:00<00:13,  2.81it/s]
  5%|>>>                                                             | 2/40 [00:00<00:14,  2.62it/s]
  8%|>>>>                                                            | 3/40 [00:01<00:16,  2.26it/s]
 10%|>>>>>>                                                          | 4/40 [00:01<00:17,  2.06it/s]
 12%|>>>>>>>>                                                        | 5/40 [00:02<00:17,  2.03it/s]
 15%|>>>>>>>>>                                                       | 6/40 [00:02<00:15,  2.19it/s]
 18%|>>>>>>>>>>>                                                     | 7/40 [00:03<00:14,  2.36it/s]
 20%|>>>>>>>>>>>>                                                    | 8/40 [00:03<00:12,  2.52it/s]
 22%|>>>>>>>>>>>>>>                                                  | 9/40 [00:03<00:12,  2.51it/s]
 25%|>>>>>>>>>>>>>>>                                                | 10/40 [00:04<00:12,  2.37it/s]
 28%|>>>>>>>>>>>>>>>>>                                              | 11/40 [00:04<00:12,  2.36it/s]
 30%|>>>>>>>>>>>>>>>>>>                                             | 12/40 [00:05<00:12,  2.22it/s]
 32%|>>>>>>>>>>>>>>>>>>>>                                           | 13/40 [00:05<00:13,  2.01it/s]
 35%|>>>>>>>>>>>>>>>>>>>>>>                                         | 14/40 [00:06<00:13,  1.89it/s]
 38%|>>>>>>>>>>>>>>>>>>>>>>>                                        | 15/40 [00:06<00:13,  1.86it/s]
 40%|>>>>>>>>>>>>>>>>>>>>>>>>>                                      | 16/40 [00:07<00:12,  1.97it/s]
 42%|>>>>>>>>>>>>>>>>>>>>>>>>>>                                     | 17/40 [00:07<00:10,  2.19it/s]
 45%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                   | 18/40 [00:08<00:08,  2.50it/s]
 48%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                  | 19/40 [00:08<00:07,  2.71it/s]
 50%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                | 20/40 [00:08<00:07,  2.64it/s]
 52%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                              | 21/40 [00:09<00:07,  2.39it/s]
 55%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                             | 22/40 [00:09<00:08,  2.17it/s]
 57%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                           | 23/40 [00:10<00:08,  2.11it/s]
 60%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                          | 24/40 [00:10<00:07,  2.23it/s]
 62%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                        | 25/40 [00:11<00:06,  2.38it/s]
 65%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                       | 26/40 [00:11<00:05,  2.57it/s]
 68%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                     | 27/40 [00:11<00:05,  2.50it/s]
 70%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                   | 28/40 [00:12<00:05,  2.39it/s]
 72%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                  | 29/40 [00:12<00:04,  2.25it/s]
 75%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                | 30/40 [00:13<00:04,  2.23it/s]
 78%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>               | 31/40 [00:13<00:04,  2.12it/s]
 80%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>             | 32/40 [00:14<00:03,  2.02it/s]
 82%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>            | 33/40 [00:14<00:03,  2.33it/s]
 85%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>          | 34/40 [00:14<00:02,  2.48it/s]
 88%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        | 35/40 [00:15<00:02,  2.50it/s]
 90%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>       | 36/40 [00:15<00:01,  2.58it/s]
 92%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     | 37/40 [00:16<00:01,  2.68it/s]
 95%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>    | 38/40 [00:16<00:00,  2.64it/s]
 98%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>  | 39/40 [00:16<00:00,  2.35it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.00it/s]
100%|>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>| 40/40 [00:17<00:00,  2.27it/s]

  0%|                                                                         | 0/4 [00:00<?, ?it/s]
 25%|<<<<<<<<<<<<<<<<                                                 | 1/4 [01:25<04:15, 85.30s/it]
 50%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                                 | 2/4 [02:42<02:41, 80.56s/it]
 75%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<                 | 3/4 [04:00<01:19, 79.37s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:16<00:00, 78.06s/it]
100%|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<| 4/4 [05:16<00:00, 79.13s/it]
[2024-06-27 16:57:09,900][__main__][INFO] - 
Update: 13 | Episodes Done: 12 | Frames Seen: 001040 | FPS: 0000 | Ellapsed: 4129                               
Reward:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Success Rate:  0.00                               
Reshaped:  0.00 +-  0.00  (Min:  0.00 Max:  0.00) | Bonus:  0.00 +-  0.00  (Min:  0.00 Max:  0.00)                               
Frames/Eps: 96.0 +- 32.0  (Min: 64.0, Max 128.0)                               
Entropy:  1.330 | Policy Loss:  0.000 | Value Loss:  0.00000 | Loss: -0.013 | Grad Norm:  0.092