Skip to content
master
Switch branches/tags
Go to file
Code

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

Leveraging the Feature Distribution in Transfer-based Few-Shot Learning

This repository is the official implementation of Leveraging the Feature Distribution in Transfer-based Few-Shot Learning.

Requirements

To install requirements:

pip install -r requirements.txt

Donwloading the dataset and create base/val/novel splits:

miniImageNet

  • Change directory to filelists/miniImagenet/
  • Run 'source ./download_miniImagenet.sh'

CUB

  • Change directory to filelists/CUB/
  • Run 'source ./download_CUB.sh'

CIFAR-FS

  • Download CIFAR-FS
  • Decompress and change the filename to 'cifar-FS'
  • Move the datafile to filelists/cifar/
  • Run 'python write_cifar_filelist.py'

Training

To train the feature extractors in the paper, run this command:

For miniImageNet/CUB

python train.py --dataset [miniImagenet/CUB] --method [S2M2_R/rotation] --model [WideResNet28_10/ResNet18] --train_aug

For CIFAR-FS

python train_cifar.py --dataset cifar --method [S2M2_R/rotation] --model [WideResNet28_10/ResNet18] --train_aug

Evaluation

To evaluate my model on miniImageNet/CUB/cifar/cross, run:

python test_standard.py

Pre-trained Models

You can download pretrained models and extracted features here:

  • trained models trained on miniImageNet, CUB and CIFAR-FS using WRN.

  • Create an empty 'checkpoints' directory.

  • Untar the downloaded file and move it into 'checkpoints' folder.

📋 To extract and save the novel class features of a newly trained backbone, run:

python save_plk.py --dataset [miniImagenet/CUB] --method S2M2_R --model [trainedmodel]

Results

Our model achieves the following performance (backbone: WRN) on :

Dataset 1-shot Accuracy 5-shot Accuracy
miniImageNet 82.92+-0.26% 88.82+-0.13%
tieredImageNet 85.41+-0.25% 90.44+-0.14%
CUB 91.55+-0.19% 93.99+-0.10%
CIFAR-FS 87.69+-0.23% 90.68+-0.15%
cross domain 62.49+-0.32% 76.51+-0.18%

References

A Closer Look at Few-shot Classification

Charting the Right Manifold: Manifold Mixup for Few-shot Learning

Manifold Mixup: Better Representations by Interpolating Hidden States

Sinkhorn Distances: Lightspeed Computation of Optimal Transport

SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning

Notes on optimal transport

About

A Few-Shot classification algorithm

Resources

Releases

No releases published

Packages

No packages published

Languages