Skip to content

gauravchak/kd_early_ranker

Repository files navigation

kd_early_ranker

Covers a couple of approaches to training an early ranker with knowledge distillation from final ranker.

Code Walktrough

Code Walktrough

Files:

  1. baseline_early_ranker.py : Shows how normally early ranker is trained.
  2. kd_aux_early_ranker.py : Shows how we can train using auxiliary tasks corresponding to teacher labels.
  3. kd_shared_early_ranker.py : Uses the shared logits approach to KD.

About

Covers a couple of approaches to training an early ranker with knowledge distillation from final ranker

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages