Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

where is data/scene_observations #103

Open
WHUfreeway opened this issue Dec 19, 2022 · 2 comments
Open

where is data/scene_observations #103

WHUfreeway opened this issue Dec 19, 2022 · 2 comments

Comments

@WHUfreeway
Copy link

when i installed soundspaces0.1.2 with habitat-0.1.7, after downloading dataset, I tryed to start to train the model, but a problem occured:
speaks that I lose file 'data/scene_observation/replica/apartment_0.pkl'
where can i get these files?
and when i tryed to just to run the pretrained models as instruction 4 'Generate demo video with audio', problem also occured that raise an EOF error.

here is my console output:
(habitat_cuda) fyw@7049GP-TRT:/data1/fyw/soundspaces/sound-spaces-0.1.2$ python ss_baselines/av_nav/run.py --exp-config
ss_baselines/av_nav/config/audionav/replica/train_telephone/audiogoal_depth.yaml --model-dir data/models/replica/audiogoal_depth
2022-12-19 22:56:16.318318: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:16.475771: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:17.063157: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:17.063246: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:17.063257: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
data/models/replica/audiogoal_depth/tb exists
data/models/replica/audiogoal_depth/data exists
Output directory already exists! Overwrite the folder? (y/n)y
2022-12-19 22:56:20,932 config: BASE_TASK_CONFIG_PATH: configs/audionav/av_nav/replica/audiogoal.yaml
CHECKPOINT_FOLDER: data/models/replica/audiogoal_depth/data
CHECKPOINT_INTERVAL: 50
CMD_TRAILING_OPTS: []
DEBUG: False
DISPLAY_RESOLUTION: 128
ENV_NAME: AudioNavRLEnv
EVAL:
SPLIT: val
USE_CKPT_CONFIG: True
EVAL_CKPT_PATH_DIR: data/models/replica/audiogoal_depth/data
EXTRA_RGB: False
LOG_FILE: data/models/replica/audiogoal_depth/train.log
LOG_INTERVAL: 10
NUM_PROCESSES: 5
NUM_UPDATES: 40000
RL:
DISTANCE_REWARD_SCALE: 1.0
PPO:
clip_param: 0.1
entropy_coef: 0.2
eps: 1e-05
gamma: 0.99
hidden_size: 512
lr: 0.00025
max_grad_norm: 0.5
num_mini_batch: 1
num_steps: 150
ppo_epoch: 4
reward_window_size: 50
tau: 0.95
use_gae: True
use_linear_clip_decay: True
use_linear_lr_decay: True
value_loss_coef: 0.5
SLACK_REWARD: -0.01
SUCCESS_REWARD: 10.0
TIME_DIFF: False
WITH_DISTANCE_REWARD: True
WITH_TIME_PENALTY: True
SEED: 0
SENSORS: ['DEPTH_SENSOR']
SIMULATOR_GPU_ID: 0
TASK_CONFIG:
DATASET:
CONTENT_SCENES: ['*']
DATA_PATH: data/datasets/audionav/replica/{version}/{split}/{split}.json.gz
SCENES_DIR: data/scene_datasets/replica
SPLIT: train_telephone
TYPE: AudioNav
VERSION: v1
ENVIRONMENT:
ITERATOR_OPTIONS:
CYCLE: True
GROUP_BY_SCENE: True
MAX_SCENE_REPEAT_EPISODES: -1
MAX_SCENE_REPEAT_STEPS: 10000
NUM_EPISODE_SAMPLE: -1
SHUFFLE: True
STEP_REPETITION_RANGE: 0.2
MAX_EPISODE_SECONDS: 10000000
MAX_EPISODE_STEPS: 500
PYROBOT:
BASE_CONTROLLER: proportional
BASE_PLANNER: none
BUMP_SENSOR:
TYPE: PyRobotBumpSensor
DEPTH_SENSOR:
CENTER_CROP: False
HEIGHT: 480
MAX_DEPTH: 5.0
MIN_DEPTH: 0.0
NORMALIZE_DEPTH: True
TYPE: PyRobotDepthSensor
WIDTH: 640
LOCOBOT:
ACTIONS: ['BASE_ACTIONS', 'CAMERA_ACTIONS']
BASE_ACTIONS: ['go_to_relative', 'go_to_absolute']
CAMERA_ACTIONS: ['set_pan', 'set_tilt', 'set_pan_tilt']
RGB_SENSOR:
CENTER_CROP: False
HEIGHT: 480
TYPE: PyRobotRGBSensor
WIDTH: 640
ROBOT: locobot
ROBOTS: ['locobot']
SENSORS: ['RGB_SENSOR', 'DEPTH_SENSOR', 'BUMP_SENSOR']
SEED: 100
SIMULATOR:
ACTION_SPACE_CONFIG: v0
AGENTS: ['AGENT_0']
AGENT_0:
ANGULAR_ACCELERATION: 12.56
ANGULAR_FRICTION: 1.0
COEFFICIENT_OF_RESTITUTION: 0.0
HEIGHT: 1.5
IS_SET_START_STATE: False
LINEAR_ACCELERATION: 20.0
LINEAR_FRICTION: 0.5
MASS: 32.0
RADIUS: 0.1
SENSORS: ['RGB_SENSOR']
START_POSITION: [0, 0, 0]
START_ROTATION: [0, 0, 0, 1]
AUDIO:
BINAURAL_RIR_DIR: data/binaural_rirs
EVERLASTING: True
GRAPH_FILE: graph.pkl
HAS_DISTRACTOR_SOUND: False
METADATA_DIR: data/metadata
POINTS_FILE: points.txt
RIR_SAMPLING_RATE: 44100
SCENE:
SOURCE_SOUND_DIR: data/sounds/1s_all
CONTINUOUS_VIEW_CHANGE: False
DEFAULT_AGENT_ID: 0
DEPTH_SENSOR:
HEIGHT: 128
HFOV: 90
MAX_DEPTH: 10.0
MIN_DEPTH: 0.0
NORMALIZE_DEPTH: True
ORIENTATION: [0.0, 0.0, 0.0]
POSITION: [0, 1.25, 0]
TYPE: HabitatSimDepthSensor
WIDTH: 128
FORWARD_STEP_SIZE: 0.5
GRID_SIZE: 0.5
HABITAT_SIM_V0:
ALLOW_SLIDING: True
ENABLE_PHYSICS: False
GPU_DEVICE_ID: 0
GPU_GPU: False
PHYSICS_CONFIG_FILE: ./data/default.physics_config.json
RGB_SENSOR:
HEIGHT: 128
HFOV: 90
ORIENTATION: [0.0, 0.0, 0.0]
POSITION: [0, 1.25, 0]
TYPE: HabitatSimRGBSensor
WIDTH: 128
SCENE: data/scene_datasets/habitat-test-scenes/van-gogh-room.glb
SCENE_DATASET: replica
SCENE_OBSERVATION_DIR: data/scene_observations
SEED: 100
SEMANTIC_SENSOR:
HEIGHT: 480
HFOV: 90
ORIENTATION: [0.0, 0.0, 0.0]
POSITION: [0, 1.25, 0]
TYPE: HabitatSimSemanticSensor
WIDTH: 640
TILT_ANGLE: 15
TURN_ANGLE: 10
TYPE: SoundSpacesSim
USE_RENDERED_OBSERVATIONS: True
USE_SYNC_VECENV: False
VIEW_CHANGE_FPS: 10
TASK:
ACTIONS:
ANSWER:
TYPE: AnswerAction
LOOK_DOWN:
TYPE: LookDownAction
LOOK_UP:
TYPE: LookUpAction
MOVE_FORWARD:
TYPE: MoveForwardAction
STOP:
TYPE: StopAction
TELEPORT:
TYPE: TeleportAction
TURN_LEFT:
TYPE: TurnLeftAction
TURN_RIGHT:
TYPE: TurnRightAction
ANSWER_ACCURACY:
TYPE: AnswerAccuracy
AUDIOGOAL_SENSOR:
TYPE: AudioGoalSensor
COLLISIONS:
TYPE: Collisions
COMPASS_SENSOR:
TYPE: CompassSensor
CORRECT_ANSWER:
TYPE: CorrectAnswer
DISTANCE_TO_GOAL:
DISTANCE_TO: POINT
TYPE: DistanceToGoal
EPISODE_INFO:
TYPE: EpisodeInfo
GOAL_SENSOR_UUID: spectrogram
GPS_SENSOR:
DIMENSIONALITY: 2
TYPE: GPSSensor
HEADING_SENSOR:
TYPE: HeadingSensor
IMAGEGOAL_SENSOR:
TYPE: ImageGoalSensor
INSTRUCTION_SENSOR:
TYPE: InstructionSensor
INSTRUCTION_SENSOR_UUID: instruction
MEASUREMENTS: ['DISTANCE_TO_GOAL', 'NORMALIZED_DISTANCE_TO_GOAL', 'SUCCESS', 'SPL', 'SOFT_SPL', 'NUM_ACTION', 'SUCCESS_WEIGHTED_BY_NUM_ACTION']
NORMALIZED_DISTANCE_TO_GOAL:
TYPE: NormalizedDistanceToGoal
NUM_ACTION:
TYPE: NA
OBJECTGOAL_SENSOR:
GOAL_SPEC: TASK_CATEGORY_ID
GOAL_SPEC_MAX_VAL: 50
TYPE: ObjectGoalSensor
POINTGOAL_SENSOR:
DIMENSIONALITY: 2
GOAL_FORMAT: POLAR
TYPE: PointGoalSensor
POINTGOAL_WITH_GPS_COMPASS_SENSOR:
DIMENSIONALITY: 2
GOAL_FORMAT: POLAR
TYPE: PointGoalWithGPSCompassSensor
POSSIBLE_ACTIONS: ['STOP', 'MOVE_FORWARD', 'TURN_LEFT', 'TURN_RIGHT']
PROXIMITY_SENSOR:
MAX_DETECTION_RADIUS: 2.0
TYPE: ProximitySensor
QUESTION_SENSOR:
TYPE: QuestionSensor
SENSORS: ['SPECTROGRAM_SENSOR']
SOFT_SPL:
TYPE: SoftSPL
SPECTROGRAM_SENSOR:
TYPE: SpectrogramSensor
SPL:
SUCCESS_DISTANCE: 0.2
TYPE: SPL
SUCCESS:
SUCCESS_DISTANCE: 0.2
TYPE: Success
SUCCESS_DISTANCE: 0.2
SUCCESS_WEIGHTED_BY_NUM_ACTION:
TYPE: SNA
TOP_DOWN_MAP:
DRAW_BORDER: True
DRAW_GOAL_AABBS: True
DRAW_GOAL_POSITIONS: True
DRAW_SHORTEST_PATH: True
DRAW_SOURCE: True
DRAW_SOURCE_AND_TARGET: True
DRAW_VIEW_POINTS: True
FOG_OF_WAR:
DRAW: True
FOV: 90
VISIBILITY_DIST: 5.0
MAP_PADDING: 3
MAP_RESOLUTION: 10000
MAX_EPISODE_STEPS: 1000
TYPE: TopDownMap
TYPE: AudioNav
TENSORBOARD_DIR: data/models/replica/audiogoal_depth/tb
TEST_EPISODE_COUNT: 2
TORCH_GPU_ID: 0
TRAINER_NAME: AVNavTrainer
USE_LAST_CKPT: False
USE_SYNC_VECENV: False
USE_VECENV: True
VIDEO_DIR: data/models/replica/audiogoal_depth/video_dir
VIDEO_OPTION: []
VISUALIZATION_OPTION: []
2022-12-19 22:56:20,933 Initializing dataset AudioNav
2022-12-19 22:56:20, INFO: Using VectorEnv
2022-12-19 22:56:23.734928: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:23.741468: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:23.780980: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:23.817418: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:23.875324: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-12-19 22:56:23.898933: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:23.902790: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:23.917278: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:23.970617: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:24.035279: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable TF_ENABLE_ONEDNN_OPTS=0.
2022-12-19 22:56:24.643324: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.643448: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.643460: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-12-19 22:56:24.651956: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.652052: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.652065: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-12-19 22:56:24.652287: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.652382: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.652394: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-12-19 22:56:24.729861: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.729981: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.729994: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-12-19 22:56:24.792559: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.792655: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/site-packages/cv2/../../lib64:
2022-12-19 22:56:24.792667: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2022-12-19 22:56:25,091 Initializing dataset AudioNav
2022-12-19 22:56:25,092 Initializing dataset AudioNav
2022-12-19 22:56:25,105 Initializing dataset AudioNav
2022-12-19 22:56:25,170 Initializing dataset AudioNav
2022-12-19 22:56:25,233 Initializing dataset AudioNav
2022-12-19 22:56:25, INFO: Sampled 13132 from frl_apartment_2
2022-12-19 22:56:25, INFO: Sampled 1892 from room_0
2022-12-19 22:56:25,442 initializing sim SoundSpacesSim
Process ForkServerProcess-4:
Traceback (most recent call last):
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner
return func(*args, **kwds)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env
env = env_fn(*env_fn_args)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn
env = env_class(config=config, dataset=dataset)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init
super().init(self._core_env_config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init
self._env = Env(config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init
id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR
File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim
return _sim(**kwargs)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init
with open(self.current_scene_observation_file, 'rb') as fo:
FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/frl_apartment_2.pkl'
2022-12-19 22:56:25, INFO: Sampled 13882 from frl_apartment_1
2022-12-19 22:56:25, INFO: Sampled 1526 from hotel_0
2022-12-19 22:56:25, INFO: Sampled 13670 from frl_apartment_0
2022-12-19 22:56:25,496 initializing sim SoundSpacesSim
Process ForkServerProcess-3:
Traceback (most recent call last):
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner
return func(*args, **kwds)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env
env = env_fn(*env_fn_args)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn
env = env_class(config=config, dataset=dataset)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init
super().init(self._core_env_config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init
self._env = Env(config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init
id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR
File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim
return _sim(**kwargs)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init
with open(self.current_scene_observation_file, 'rb') as fo:
FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/hotel_0.pkl'
2022-12-19 22:56:25, INFO: Sampled 17220 from frl_apartment_3
2022-12-19 22:56:25,659 initializing sim SoundSpacesSim
Process ForkServerProcess-5:
Traceback (most recent call last):
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner
return func(*args, **kwds)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env
env = env_fn(*env_fn_args)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn
env = env_class(config=config, dataset=dataset)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init
super().init(self._core_env_config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init
self._env = Env(config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init
id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR
File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim
return _sim(**kwargs)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init
with open(self.current_scene_observation_file, 'rb') as fo:
FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/frl_apartment_3.pkl'
2022-12-19 22:56:25, INFO: Sampled 4360 from office_4
2022-12-19 22:56:25,737 initializing sim SoundSpacesSim
Process ForkServerProcess-2:
Traceback (most recent call last):
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner
return func(*args, **kwds)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env
env = env_fn(*env_fn_args)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn
env = env_class(config=config, dataset=dataset)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init
super().init(self._core_env_config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init
self._env = Env(config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init
id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR
File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim
return _sim(**kwargs)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init
with open(self.current_scene_observation_file, 'rb') as fo:
FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/office_4.pkl'
2022-12-19 22:56:26, INFO: Sampled 40748 from apartment_0
2022-12-19 22:56:26, INFO: Sampled 388 from office_0
2022-12-19 22:56:26,288 initializing sim SoundSpacesSim
Process ForkServerProcess-1:
Traceback (most recent call last):
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
self.run()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/process.py", line 99, in run
self._target(*self._args, **self._kwargs)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/contextlib.py", line 74, in inner
return func(*args, **kwds)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 233, in _worker_env
env = env_fn(*env_fn_args)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 131, in make_env_fn
env = env_class(config=config, dataset=dataset)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/environments.py", line 46, in init
super().init(self._core_env_config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 336, in init
self._env = Env(config, dataset)
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/env.py", line 110, in init
id_sim=self._config.SIMULATOR.TYPE, config=self._config.SIMULATOR
File "/data1/fyw/soundspaces/habitat-lab/habitat/sims/registration.py", line 19, in make_sim
return _sim(**kwargs)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/soundspaces/simulator.py", line 164, in init
with open(self.current_scene_observation_file, 'rb') as fo:
FileNotFoundError: [Errno 2] No such file or directory: 'data/scene_observations/replica/apartment_0.pkl'
Traceback (most recent call last):
File "ss_baselines/av_nav/run.py", line 101, in
main()
File "ss_baselines/av_nav/run.py", line 95, in main
trainer.train()
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/av_nav/ppo/ppo_trainer.py", line 234, in train
self.config, get_env_class(self.config.ENV_NAME)
File "/data1/fyw/soundspaces/sound-spaces-0.1.2/ss_baselines/common/env_utils.py", line 102, in construct_envs
auto_reset_done=auto_reset_done
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 194, in init
read_fn() for read_fn in self._connection_read_fns
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 194, in
read_fn() for read_fn in self._connection_read_fns
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 97, in call
res = self.read_fn()
File "/data1/fyw/soundspaces/habitat-lab/habitat/utils/pickle5_multiprocessing.py", line 68, in recv
buf = self.recv_bytes()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 216, in recv_bytes
buf = self._recv_bytes(maxlength)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 407, in _recv_bytes
buf = self._recv(4)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 379, in _recv
chunk = read(handle, remaining)
ConnectionResetError: [Errno 104] Connection reset by peer
Exception ignored in: <function VectorEnv.del at 0x7fc15fa98950>
Traceback (most recent call last):
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 588, in del
self.close()
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 456, in close
read_fn()
File "/data1/fyw/soundspaces/habitat-lab/habitat/core/vector_env.py", line 97, in call
res = self.read_fn()
File "/data1/fyw/soundspaces/habitat-lab/habitat/utils/pickle5_multiprocessing.py", line 68, in recv
buf = self.recv_bytes()
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 216, in recv_bytes
buf = self._recv_bytes(maxlength)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 407, in _recv_bytes
buf = self._recv(4)
File "/home/fyw/anaconda3/envs/habitat_cuda/lib/python3.7/multiprocessing/connection.py", line 383, in _recv
raise EOFError

@ChanganVR
Copy link
Contributor

@WHUfreeway scene_observations are the rendered RGB-D images for all pairs of points in each scene. You need to run this script to cache the observations. Furthermore, check this step-by-step installation guide for instructions.

Let me know if you have other questions!

@sheldonwuchiha
Copy link

sheldonwuchiha commented Apr 11, 2024

@ChanganVR I am a little confused about when I run this script, the bug comes out saying HabitatSimRGBSensor object has no attribute _getdefault_spec, I used habitat-0.1.7,too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants