Skip to content

Boosting the Performance of Generic Deep Neural Network Frameworks with Log-supermodular CRFs

License

Notifications You must be signed in to change notification settings

motionlife/CRFBoostedDNN

Repository files navigation

NeuralizedCRF

A general framework to embed Markov Random Field into deep neural networks for structure prediction tasks, e.g. stereo matching, image colorization, image denoising etc.

Architecture

Installation

Use the package manager pip or conda to install your tensorflow 2.2 GPU environment and other dependencies.

conda create -n tf python=3.8 cudatoolkit=10.1 cudnn tensoflow=2.2 matplotlib pillow 

Download corresponding datasets if you want to train your own model weights, pretrained weights download link: Download Weights

Usage

We currently applied this framework on stereo matching task and image colorization task.

# train stereo matching model from scratch
python stereo.py

# training image colorization model from scratch
python colorization.py

# colorize your image using pretrained model
python colorization.py --colorize --img_dir="your/test/image/directory" --weights="weights/file/path"

example output

Stereo Matching:

Stereo

Colorization:

Colorization-bruce-lee

Colorization-girl

Colorization-chat

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

License

MIT

About

Boosting the Performance of Generic Deep Neural Network Frameworks with Log-supermodular CRFs

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published