Tobias Schmidt, Steffen Schneider and Matthias Bethge
Accepted at NeurIPS 2025.
🔗 https://arxiv.org/abs/2510.21706
🚧 This repository is currently under construction. You can follow issue #1 if you'd like to be notified about the first code release.
We propose Equivariance by Contrast (EbC) to learn equivariant embeddings from observation pairs (y, g · y), where g is drawn from a finite group acting on the data. Our method jointly learns a latent space and a group representation in which group actions correspond to invertible linear maps—without relying on group-specific inductive biases. We validate our approach on the infinite dSprites dataset with structured transformations defined by the finite group G := (Rm × Zn × Zn), combining discrete rotations and periodic translations. The resulting embeddings exhibit high-fidelity equivariance, with group operations faithfully reproduced in latent space. On synthetic data, we further validate the approach on the nonabelian orthogonal group O(n) and the general linear group GL(n). We also provide a theoretical proof for identifiability. While broad evaluation across diverse group types on real-world data remains future work, our results constitute the first successful demonstration of general-purpose encoder-only equivariant learning from group action observations alone, including non-trivial non-abelian groups and a product group motivated by modeling affine equivariances in computer vision.
@inproceedings{
schmidt2025ebc,
title={Equivariance by Contrast: Identifiable Equivariant Embeddings from Unlabeled Finite Group Actions},
author={Anonymous},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
year={2025},
url={https://doi.org/10.48550/arXiv.2510.21706}
}