PyTorch Code for the following paper at ICLR2020:
Title: DivideMix: Learning with Noisy Labels as Semi-supervised Learning [pdf]
Authors:Junnan Li, Richard Socher, Steven C.H. Hoi
Institute: Salesforce Research
Abstract
Deep neural networks are known to be annotation-hungry. Numerous efforts have been devoted to reduce the annotation cost when learning with deep networks. Two prominent directions include learning with noisy labels and semi-supervised learning by exploiting unlabeled data. In this work, we propose DivideMix, a novel framework for learning with noisy labels by leveraging semi-supervised learning techniques. In particular, DivideMix models the per-sample loss distribution with a mixture model to dynamically divide the training data into a labeled set with clean samples and an unlabeled set with noisy samples, and trains the model on both the labeled and unlabeled data in a semi-supervised manner. To avoid confirmation bias, we simultaneously train two diverged networks where each network uses the dataset division from the other network. During the semi-supervised training phase, we improve the MixMatch strategy by performing label co-refinement and label co-guessing on labeled and unlabeled samples, respectively. Experiments on multiple benchmark datasets demonstrate substantial improvements over state-of-the-art methods.
Illustration
Experiments
First, please create a folder named checkpoint to store the results.
mkdir checkpoint
Next, run
python Train_{dataset_name}.py --data_path path-to-your-data
Cite DivideMix
If you find the code useful in your research, please consider citing our paper:
@inproceedings{
li2020dividemix,
title={DivideMix: Learning with Noisy Labels as Semi-supervised Learning},
author={Junnan Li and Richard Socher and Steven C.H. Hoi},
booktitle={International Conference on Learning Representations},
year={2020},
}
License
This project is licensed under the terms of the MIT license.