Skip to content
/ sfm_dl Public

Structure from motion by Deep Unsupervised Learning. Loss and Architectural improvements were made to SFMLearner. Project 4 for CMSC733 at University of Maryland

Notifications You must be signed in to change notification settings

h-gokul/sfm_dl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Improving SFMLearner

System Pipeline:

Screenshot from 2021-09-17 14-11-46

Enhancements were made on the loss functions and the network architecture. Check the report for more details.

TRAINING:

  • Paste the TrainingAndValData/ Folder with the prepared kitti data in this folder.
  • Enter the folder using cd TrainingAndValData/
  • Copy SfMLearnerDatatrain.txt and SfMLearnerDatatrain.txt inside ./TrainingAndValData/SfMLearnerData

To train default version, check if the SfMLearner class from SfMLearner.py is imported in train.py

  • cd SfmLearner/
  • run python3 train.py

To train the modified version, check if the SfMLearner class from SfMLearner_SSIM.py is imported in train.py and perform the

  • cd SfmLearner/
  • run python3 train.py

EVALUATION: The pose evalution data is already downloaded in ./SfMLearner/kitti_eval

Download the raw odometry data from kitti website and paste it inside ./TrainingAndValData

For testing pose :

  • first run test_kitti_pose.py to get predictions, choose the appropriate groundtruth and predictions folder
  • navigate to cd kitti_eval
  • next run eval_pose to get results. Note: in case of running pretrained pose model, change sequence length = 5

For testing depth :

  • first run test_kitti_depth.py to get the depth predictions
  • navigate to cd kitti_eval
  • next run eval_depth to get results.

To visualize depth use the visualize.ipynb notebook in kitti_eval

References for modified architectures: https://github.com/yzcjtr/GeoNet

Link for presentation video: https://www.youtube.com/watch?v=bWV-gceHxxs

About

Structure from motion by Deep Unsupervised Learning. Loss and Architectural improvements were made to SFMLearner. Project 4 for CMSC733 at University of Maryland

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published