Home

Welcome to the MultiModalRegistration wiki!

The manuscript

• NIPS version

  • Abstract Submission Deadline May 05 May 27 01:00 PM PDT
  • Paper Submission Deadline May 12 Jun 03 01:00 PM PDT
  • https://nips.cc/Conferences/2020/Dates

• old ECCV version

Input Data sets

Processed data (before registration)

• Eliceiri data:
  • Eliceiri's method: where?
  • pix2pix: /data2/jiahao/Registration/pytorch-CycleGAN-and-pix2pix/results/eliceiri_p2p_rotation_a2b/ and b2a
  • CycleGAN: /data2/jiahao/Registration/pytorch-CycleGAN-and-pix2pix/results/eliceiri_cyc_rotation/
  • DRIT: ...in progress

Evaluation of Registration

Results tables can be found here.

To evaluate the quality of our feature representation, we perform the following registration tasks:

• Johan's method on latent spaces resulting of the proposed method, both ways: L1->L2, L2->1
• Johan's method on image translation by pix2pix: generated HE -> original HE, generated SHG -> original SHG
• Johan's method on image translation by CycleGAN: generated HE -> original HE, generated SHG -> original SHG
• MI on latent spaces resulting of the proposed method, both ways: L1->L2, L2->1
• MI on image translation by pix2pix: generated HE -> original HE, generated SHG -> original SHG
• MI on image translation by CycleGAN: generated HE -> original HE, generated SHG -> original SHG
• SIFT on latent spaces resulting of the proposed method, both ways: L1->L2, L2->1
• SIFT on image translation by pix2pix: generated HE -> original HE, generated SHG -> original SHG
• SIFT on image translation by CycleGAN: generated HE -> original HE, generated SHG -> original SHG
• Elicieri's method

Further possibilities: UMDRIT (-> content/attirbute splitting + registration of latent spaces), but it's a bit out of the story line of that we find representations that are good enough to facilitate monomodal registration.

Evaluation of Equivariances

Still needs some discussion.

Evaluation of "Channel-Control"

Still needs some discussion. Maybe improved registration by Johan's method?

Evaluation of Hyperparameter Stability

Still needs some discussion.

Milestone 1

https://github.com/elisabethwetzer/MultiModalRegistration/milestone/1