Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

OSVOS: One-Shot Video Object Segmentation

Architecture of the Deep Neural Network for OSVOS-S

OSVOS

OSVOS is a method that tackles the task of semi-supervised video object segmentation. It is based on a fully-convolutional neural network architecture that is able to successively transfer generic semantic information, learned on ImageNet, to the task of foreground segmentation, and finally to learning the appearance of a single annotated object of the test sequence (hence one-shot). Experiments on DAVIS 2019 show that OSVOS is faster than currently available techniques and improves the state of the art by a significant margin (79.8% vs 68.0%).

OSVOS

This TensorFlow code is a posteriori implementation of OSVOS and it does not contain the boundary snapping branch. The results published in the paper were obtained using the Caffe version that can be found at OSVOS-caffe.

Expected Output with DAVIS 2019 Test-Dev Dataset with the first frame annotated (Overlay code Not included)

OSVOS

Installation:

  1. Clone the OSVOS-TensorFlow repository

    git clone https://github.com/imdsi/OSVOS.git
  2. Install if necessary the required dependencies:

    • Python 2.7, Python 3
    • Tensorflow r1.0 or higher (pip install tensorflow-gpu) along with standard dependencies
    • Other python dependencies: PIL (Pillow version), numpy, scipy, matplotlib, six
  3. Download the parent model from here (55 MB) and unzip it under models/ (It should create a folder named 'OSVOS_parent').

  4. All the steps to re-train OSVOS are provided in this repository. In case you would like to test with the pre-trained models, you can download them from here (2.2GB) and unzip them under models/ (It should create a folder for every model).

Demo online training and testing

  1. Edit in file osvos_demo.py the 'User defined parameters' (eg. gpu_id, train_model, etc).

  2. Run python osvos_demo.py.

It is possible to work with all sequences of DAVIS 2016 just by creating a soft link (ln -s /path/to/DAVIS/ DAVIS) in the root folder of the project.

Training the parent network (optional)

  1. All the training sequences of DAVIS 2016 are required to train the parent model, thus download it from here if you don't have it.
  2. Place the dataset in this repository or create a soft link to it (ln -s /path/to/DAVIS/ DAVIS) if you have it somewhere else.
  3. Download the VGG 16 model trained on Imagenet from the TF model zoo from here.
  4. Place the vgg_16.ckpt file inside models/.
  5. Edit the 'User defined parameters' (eg. gpu_id) in file osvos_parent_demo.py.
  6. Run python osvos_parent_demo.py. This step takes 20 hours to train (Titan-X Pascal), and ~15GB for loading data and online data augmentation. Change dataset.py accordingly, to adjust to a less memory-intensive setup.

Have a happy training!

If you encounter any problems with the code, want to report bugs, etc. please contact me at xmandsi@gmail.com

Check our project page for additional information.

About

No description, website, or topics provided.

Resources

License

Releases

No releases published

Packages

No packages published

Languages