why def sync_out(self, device="cpu"): use cpu and I can't find weight averaged

[xiezhipeng-git]

I found agent def sync_out(self, device="cpu") use cpu.then I try change to gpu.then I change code
def sync_out(self, device="cpu"):
device = self.device
or device = self.device.type
1.but it has error in async.
2.in addition I can't find weight averaged code.If there is no average weight on different machines, what is the significance of synchronizing data? Always the last number to repeat.seems ppo alyays >32step data to learn one times. it will 31 times sync loss

sync_out
Fatal Python error: pygame_parachute: (pygame parachute) Segmentation Fault
Python runtime state: initialized

Thread 0x00006dd0 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 231 in _feed
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00002b60 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\connection.py", line 310 in _recv_bytes
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\connection.py", line 221 in recv_bytes
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 103 in get
File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy\process.py", line 94 in gather_thread
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00000fa4 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 231 in _feed
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 917 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydev_bundle\pydev_monkey.py", line 1053 in call

Thread 0x00001750 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd\pydevd.py", line 261 in _on_run
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00006694 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd\pydevd.py", line 215 in _on_run
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00004e18 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 312 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 581 in wait
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_timeout.py", line 43 in _on_run
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00005878 (most recent call first):
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 204 in _read_line
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 222 in _on_run
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Thread 0x00005704 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 316 in wait
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\queue.py", line 180 in get
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_comm.py", line 367 in _on_run
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_daemon_thread.py", line 49 in run
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 980 in _bootstrap_inner
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\threading.py", line 937 in _bootstrap

Current thread 0x00003018 (most recent call first):
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\site-packages\torch\storage.py", line 932 in _new_shared_cuda
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\site-packages\torch\multiprocessing\reductions.py", line 121 in rebuild_cuda_tensor
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 122 in get
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\multiprocessing\queues.py", line 135 in get_nowait
File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy\run_mode.py", line 426 in async_distributed_train
File "E:\study\machineStudy\project\rlFrame\rl_frame/jorldy/main.py", line 46 in
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 124 in _run_code
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 135 in run_module_code
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_vendored\pydevd_pydevd_bundle\pydevd_runpy.py", line 321 in run_path
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py", line 284 in
run_file
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy/..\debugpy\server\cli.py", line 430 in
main
File "c:\Users\hasee.vscode\extensions\ms-python.python-2022.18.2\pythonFiles\lib\python\debugpy_main.py", line 39 in
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\runpy.py", line 87 in _run_code
File "C:\Users\hasee\AppData\Local\Programs\Python\python-3.9.13\lib\runpy.py", line 197 in _run_module_as_main