-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Can't find "inputNumbers500.npy" #18
Comments
Hello @berthaSZ, Thank you for reaching out to us about this issue. Based on the error that you faced, it seems that the I just updated the main branch with removing the duplicated update of the variable args.ad_path. This update only applies for training locally on your computer. If you are using another training method, just make sure that the Thanks, |
Thank you @Somayeh-h . I tried it again after pulling your updates. However, it still throws the same error. Traceback (most recent call last): |
Hi @berthaSZ, I have just updated the repo with another commit, remving the integer value for the saved input numbers used for training, I hope it makes sense. I had removed this from this public version of the code to make it easier, but missed testing it for the case where every epoch is evaluated for calibration. Thank you for raising this issue. After training a module, please check the output folder to verify that the saved output files exist. Thanks, |
Hi @Somayeh-h, After your recent updates, I was able to execute python3 modular_snn/modular_snn_processing.py --run_mode="local" --process_mode="train" --dataset='nordland' --num_labels=25 --num_cal_labels=600 --num_test_labels=2700 --num_query_imgs=3300 --skip=8 --offset_after_skip=0 --update_interval=250 --folder_id='NRD_SFS' --n_e=400 --epochs=80 --seed=0 It has been running since last Monday. Yes, it is still running :) Here is how my /outputs directory tree looks: Click to expandoutputs/├── outputs_ne100_L5_offset0 73 directories, 836 files In Click to expandNamespace(ad_path='_offset150', ad_path_test='_test_E80', dataset='nordland', epochs=80, folder_id='NRD_SFS', intensity=4, multi_path='epoch80_T600_T0', n_e=400, num_cal_labels=600, num_labels=25, num_query_imgs=3300, num_test_labels=600, offset_after_skip=150, process_mode='calibrate', project_name='modularSNN', run_mode='local', seed=0, shuffled=True, skip=8, sweep_name='sweep_1', tc_ge=1.0, tc_gi=0.5, threshold_i=0, update_interval=250, use_weighted_assignments=False, username='my_username') Differences: Accuracy: 0.0, num correct: 0, num incorrect: 25 ====> Recall Recall@1: 0.0000 I checked the other logfiles. However, I could not find a Recall@1 value greater than 0.08. I would be appreciative if you could help me to understand what I am doing wrong. Best, |
Hi @berthaSZ, Thanks for sharing the details about your outputs. Apologies for the delay in getting back to you. The output directory tree looks good. You can speed up the training process by using only 60 epochs (as for our ICRA 2023 work). I’ve made some modifications in this commit: [ebf6e09] to speed up training. In regards to the accuracy, could you please confirm that you are using this version of the Nordland dataset? We use the Spring and Fall traverses as the reference set, and the Summer traverse as the query set for testing the model. You can also access the learned weights of our modular SNN on Nordland dataset here. The R@1 reported in the log files relate to the performance of a single module on the particular segment it was trained on. After training all modules, use the Best, |
Hello @Somayeh-h,
I was trying to run "modular_snn/modular_snn_processing.py". However, after executing some training steps it returns the following error.
File "modular_snn/modular_snn_processing.py", line 191, in
main(args)
File "modular_snn/modular_snn_processing.py", line 105, in main
process_one_snn_module(args)
File "/home/bertha/VPRSNN/modular_snn/one_snn_module_processing.py", line 110, in main
evaluate_snn_module(args)
File "/home/bertha/VPRSNN/non_modular_snn/snn_model_evaluation.py", line 105, in main
training_input_numbers = np.load(main_folder_path + 'inputNumbers' + training_ending + ending)
File "/home/bertha/.pyenv/versions/VPRSNN_virtualenv/lib/python3.8/site-packages/numpy/lib/npyio.py", line 405, in load
fid = stack.enter_context(open(os_fspath(file), "rb"))
FileNotFoundError: [Errno 2] No such file or directory: './outputs/outputs_ne400_L25_offset{}/inputNumbers500.npy'
I made sure that my python environment has the necessary packages and I organized the Nordland data paths accordingly. Would you try to setup a new python environment and see if you can reproduce this error? It would be great if you can help me to solve this.
Best,
Bertha
The text was updated successfully, but these errors were encountered: