Minor errors regarding the released dataset

[SunHaoOne]

Make sure you have read FAQ before posting.
Thanks!
Hello，
Sorry to disrupt you again. After reading the FAQ carefully, I downloaded your released datasets, there are some small mistakes here. And there is some problem about launching carla, I guess this problem leads to the errors about training the ego model.

1 datasets lose key and value

For example,

real_file='/home/shy/Desktop/aazijolwvf'
json_file=real_file+'/data.json'
data = json.load(open(json_file))
data['0']
{'loc': [655.82763671875, 30.739931106567383, 0.03367812931537628],
 'rot': [-91.5350341796875],
 'spd': [2.312199831008911],
 'cmd': [4.0],
 'lbl_00': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_00_00000.png',
 'lbl_01': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_01_00000.png',
 'lbl_02': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_02_00000.png',
 'lbl_03': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_03_00000.png',
 'lbl_04': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_04_00000.png',
 'lbl_05': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_05_00000.png',
 'lbl_06': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_06_00000.png',
 'lbl_07': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_07_00000.png',
 'lbl_08': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_08_00000.png',
 'lbl_09': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_09_00000.png',
 'lbl_10': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_10_00000.png',
 'lbl_11': '/ssd2/dian/challenge_data/main_trajs6_converted/aazijolwvf/rgbs/lbl_11_00000.png',
 'wide_rgb_{}': '/rgbs/narr_rgb_2_00000.jpg',
 'wide_sem_{}': '/rgbs/wide_sem_2_00000.png',
 'narr_sem_{}': '/rgbs/narr_sem_2_00000.png'}

It seems that the narr_rgb_{} key and value is lost, and the file name does not correspond to the value in this json file. Besides, the value of wide_rgb_{} is also needs to be changed. So the code here is provided:

import json
real_file='/home/shy/Desktop/aazijolwvf'
#json_file ='/home/shy/Desktop/aazijolwvf/data.json'
json_file=real_file+'/data.json'
json_save_file=real_file+'/data_new.json'
data = json.load(open(json_file))

for i in range(data['len']):
    idx = str(i)
    data[idx]['narr_rgb_{}']=data[idx]['wide_rgb_{}']
    wide_value = data[idx]['wide_rgb_{}'][:6]+'wide'+data[idx]['wide_rgb_{}'][10:]
    #print("wide value is", wide_value)
    data[idx]['wide_rgb_{}']=wide_value

    # data['0'].keys()
    key_change_lbl = [key for key in data[idx].keys()][4:16]
    key_change_rgb=[ [key for key in data[idx].keys()][16],[key for key in data[idx].keys()][19] ]
    key_change_sem=[ [key for key in data[idx].keys()][17],[key for key in data[idx].keys()][18] ]
    for key in key_change_lbl:
        #print("data",data['0'][key])
        real_str = data[idx][key][58:]
        data_new=real_file+real_str
        data[idx][key] = data_new
    for key in key_change_rgb:
    # remove_rgb
        real_str_first= data[idx][key][:10]
        real_str_last= data[idx][key][14:]
        data_new=real_file+real_str_first+real_str_last
        data[idx][key] = data_new

    for key in key_change_sem:
        real_str= data[idx][key]
        data_new=real_file+real_str
        data[idx][key] = data_new
    

with open(json_save_file, 'w') as outfile:
    json.dump(data, outfile)

And for testing, we set a random number, the code is following:

import numpy as np
idx = np.random.randint(0,200)
print("The index is",idx)
idx = str(idx)
key_images= [key for key in data[idx].keys()][4:]
for key in key_images[12:]:
    print(data[idx][key])
    x = plt.imread(data[idx][key])
   # print("x.shape",x.shape)
    plt.figure()
    plt.imshow(x)

And finally the datasets can be loaded.

2 what does 6+:lane centers mean?

I found 6-11 are lane centers,what is the difference between them or how to collect it? I thought the direction of no.11 images seems different, I guess it maybe the people's lane center?

3 Is Vulcan necessary for Carla?

I failed to launch Carla by running the launch Carla shell. In FAQ, it might be the error of Vulcan, However, I can still launch Carla using the OpenGL. And I successfully test the examples in PythonAPI. After launching Carla, I decided to train the ego_model. And first of all, I need to collect the datasets.

$ ./CarlaUE4.sh -fps 10 -world-port 2000

Then I tried

$ python -m rails.data_phase0 --num-runners=1 --port=2000
(world_on_rails) shy@carla:~/WorldOnRails0526$ python -m rails.data_phase0 --num-runners=1 --port=2000
pygame 2.0.1 (SDL 2.0.14, Python 3.7.9)
Hello from the pygame community. https://www.pygame.org/contribute.html
Traceback (most recent call last):
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/shy/WorldOnRails0526/rails/data_phase0.py", line 53, in <module>
    main(args)
  File "/home/shy/WorldOnRails0526/rails/data_phase0.py", line 16, in main
    runner = ScenarioRunner.remote(args, scenario, route, port=port, tm_port=tm_port)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/actor.py", line 407, in remote
    return self._remote(args=args, kwargs=kwargs)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/actor.py", line 658, in _remote
    kwargs)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/signature.py", line 116, in flatten_args
    raise TypeError(str(exc)) from None
TypeError: missing a required argument: 'route'

I am not sure how to fix this problem, I just do as follows:（Did I set the right scenario_class?）

runner = ScenarioRunner.remote(args,scenario_class='route_scenario', scenario=scenario, route=route, port=port, tm_port=tm_port)

After that, there is no error and it seems that the code is running at ray.wait(jobs, num_returns=args.num_runners), and no data are saved. Then I turned to phase1,

python -m rails.data_phase1 --scenario=train_scenario --num-runners=1 --port 2000

(world_on_rails) shy@carla:~/WorldOnRails0526$ python -m rails.data_phase1 --scenario=train_scenario --num-runners=1 --port 2000
pygame 2.0.1 (SDL 2.0.14, Python 3.7.9)
Hello from the pygame community. https://www.pygame.org/contribute.html
(pid=15754) pygame 2.0.1 (SDL 2.0.14, Python 3.7.9)
(pid=15754) Hello from the pygame community. https://www.pygame.org/contribute.html
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118924.664088343","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118924.664086974","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118924.664067929","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118924.663999265","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118926.269346249","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118926.269345149","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118926.269326571","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118926.269311059","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118927.908004098","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118927.908003298","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118927.907989921","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118927.907964504","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118929.553582429","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118929.553581561","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118929.553567170","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118929.553544142","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118931.222429438","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118931.222428625","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118931.222411772","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118931.222371125","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118932.839846720","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118932.839845839","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118932.839830135","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118932.839817847","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118934.437792694","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118934.437791878","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118934.437777832","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118934.437756242","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
(pid=raylet) Traceback (most recent call last):
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 317, in <module>
(pid=raylet)     raise e
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 306, in <module>
(pid=raylet)     loop.run_until_complete(agent.run())
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/asyncio/base_events.py", line 587, in run_until_complete
(pid=raylet)     return future.result()
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/ray/new_dashboard/agent.py", line 180, in run
(pid=raylet)     agent_ip_address=self.ip))
(pid=raylet)   File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/grpc/aio/_call.py", line 286, in __await__
(pid=raylet)     self._cython_call._status)
(pid=raylet) grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
(pid=raylet) 	status = StatusCode.UNAVAILABLE
(pid=raylet) 	details = "DNS resolution failed for service: https:"
(pid=raylet) 	debug_error_string = "{"created":"@1622118936.032766161","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":2132,"referenced_errors":[{"created":"@1622118936.032765376","description":"DNS resolution failed for service: https:","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":361,"grpc_status":14,"referenced_errors":[{"created":"@1622118936.032752221","description":"C-ares status is not ARES_SUCCESS qtype=A name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716,"referenced_errors":[{"created":"@1622118936.032727375","description":"C-ares status is not ARES_SUCCESS qtype=AAAA name=https is_balancer=0: Could not contact DNS servers","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":716}]}]}]}"
(pid=raylet) >
2021-05-27 20:35:37,323	ERROR worker.py:980 -- Possible unhandled error from worker: ray::ScenarioRunner.run() (pid=15754, ip=219.216.98.5)
  File "python/ray/_raylet.pyx", line 463, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 415, in ray._raylet.execute_task.function_executor
  File "/home/shy/WorldOnRails0526/runners/scenario_runner.py", line 27, in run
    return self.runner.run(self.args)
  File "/home/shy/WorldOnRails0526/leaderboard/leaderboard/leaderboard_evaluator.py", line 417, in run
    self.statistics_manager.clear_record(args.checkpoint)
  File "/home/shy/WorldOnRails0526/leaderboard/leaderboard/utils/statistics_manager.py", line 355, in clear_record
    with open(endpoint, 'w') as fd:
FileNotFoundError: [Errno 2] No such file or directory: 'results/00_simulation_results.json'

The same error can be seen in the phase2. I guess these errors are caused by the ray.Now I am confused by these data collecting errors. And I would appreciate it if you could help me fixed these errors. Thank you again!

[dotchen]

1 datasets lose key and value

I double-checked and it is a bug in my conversion script. Thank you for letting me know and I will fix it and update the dataset soon. In the meantime you can use the data collection script to generate data.

2 what does 6+:lane centers mean?

Those are the lanes for lane changing

3 Is Vulcan necessary for Carla?

No, but it runs much faster in Carla than OpenGL. The errors you see however is because there is no results folder. Simply mkdir results should do the trick.

Closing the issue for now.

[dotchen]

@SunHaoOne I have updated the dataset link, should be fixed. Let me know if you have any more questions.

[SunHaoOne]

1 datasets lose key and value

I double-checked and it is a bug in my conversion script. Thank you for letting me know and I will fix it and update the dataset soon. In the meantime you can use the data collection script to generate data.

2 what does 6+:lane centers mean?

Those are the lanes for lane changing

3 Is Vulcan necessary for Carla?

No, but it runs much faster in Carla than OpenGL. The errors you see however is because there is no results folder. Simply mkdir results should do the trick.

Closing the issue for now.

Thanks for your reply. Besides, I found there are 200 lbl images, however, the number of rgb cameras is only 195. For example, the last images of wide camera iswide_2_00194.jpg, and the last images of wide segment is wide_sem_2_00199. And I am not sure whether this problem is fixed, I will download the updating dataset link later.

[dotchen]

num_plan=5, so the last 5 rgb images will not be used for training, but the lbl will because we need them to compute the rewards from future.

[varunjammula]

@SunHaoOne Hey, were you able to make the data collector work? If you enable the wandb, you can see the logs for rails.data_phase0. I did that and I can see two errors coming up.

There is no speed sensor in CARLA_0.9.10.1. Should I make any API changes to use the Speed sensor?

@dotchen Any suggestions here?

[SunHaoOne]

@SunHaoOne Hey, were you able to make the data collector work? If you enable the wandb, you can see the logs for rails.data_phase0. I did that and I can see two errors coming up.

There is no speed sensor in CARLA_0.9.10.1. Should I make any API changes to use the Speed sensor?

@dotchen Any suggestions here?

Sorry for the late reply. I also meet this problem now, do you have any idea？（I successfully collected data for about 1400 frames before, now I cannot collect data, and I have tried to run carla again but also failed ）It shows as follows:

    control = self.run_step(input_data, timestamp)
  File "autoagents/collector_agents/random_collector.py", line 124, in run_step
    self.flush_data()
  File "autoagents/collector_agents/random_collector.py", line 67, in flush_data
    'vid': wandb.Video(np.stack(self.rgbs).transpose((0,3,1,2)), fps=20, format='mp4')
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/wandb/sdk/data_types.py", line 1036, in __init__
    self.encode()
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/wandb/sdk/data_types.py", line 1074, in encode
    clip.write_videofile(filename, **kwargs)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/decorator.py", line 232, in fun
    return caller(func, *(extras + args), **kw)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/decorators.py", line 54, in requires_duration
    return f(clip, *a, **k)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/decorator.py", line 232, in fun
    return caller(func, *(extras + args), **kw)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/decorators.py", line 135, in use_clip_fps_by_default
    return f(clip, *new_a, **new_kw)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/decorator.py", line 232, in fun
    return caller(func, *(extras + args), **kw)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/decorators.py", line 22, in convert_masks_to_RGB
    return f(clip, *a, **k)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/video/VideoClip.py", line 307, in write_videofile
    logger=logger)
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/video/io/ffmpeg_writer.py", line 216, in ffmpeg_write_video
    ffmpeg_params=ffmpeg_params) as writer:
  File "/home/shy/anaconda3/envs/world_on_rails/lib/python3.7/site-packages/moviepy/video/io/ffmpeg_writer.py", line 88, in __init__
    '-r', '%.02f' % fps,
TypeError: must be real number, not NoneType
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/home/shy/WorldOnRails0603/leaderboard/leaderboard/leaderboard_evaluator.py", line 365, in _load_and_run_scenario
    self.manager.run_scenario()
  File "/home/shy/WorldOnRails0603/leaderboard/leaderboard/scenarios/scenario_manager.py", line 136, in run_scenario
    self._tick_scenario(timestamp)
  File "/home/shy/WorldOnRails0603/leaderboard/leaderboard/scenarios/scenario_manager.py", line 159, in _tick_scenario
    raise AgentError(e)
leaderboard.autoagents.agent_wrapper.AgentError: must be real number, not NoneType 

[varunjammula]

It looks like you are passing the fps argument wrong! Check the value properly! Also try to pull the latest code from the repo.

[SunHaoOne]

It looks like you are passing the fps argument wrong! Check the value properly! Also try to pull the latest code from the repo.

Thanks for your reply, I run carla with ./carla.sh 2 2 2000 and also with the runners = 2, I can use it for collecting the data in the phase 12, ( I have collected about 140GB for 3 days) but still failed with the phase 0 . After pull the latest repo, I still failed and I will check the code again.

#!/bin/bash

num_servers=$1
num_gpus=$2
base=$3
for (( i=1; i<=$1; i++ ))
do
    port=$((i*base))
    fuser $port/tcp -k
    fuser $((port + 1))/tcp -k
    fuser $((port + 2))/tcp -k
	DISPLAY= CUDA_VISIBLE_DEVICES=$(((i-1)%num_gpus)) /home/shy/Desktop/carla0.9.10.1/CarlaUE4.sh -world-port=$port -opengl -trafficmanager-port=$((port+2)) &
done
wait

[dotchen]

@SunHaoOne reinstall moviepy, imageio and wandb

[SunHaoOne]

@SunHaoOne reinstall moviepy, imageio and wandb

Thanks you again! Wow, I fixed it and now I can collected the data.