Awesome TDL

A curated list of Topological Deep Learning (TDL) tools and resources.

1. Simplicial Neural Networks. Stefania Ebli, Michaël Defferrard, Gard Spreemann. NeurIPS 2020 Workshop TDA and Beyond. Paper, Code ,

2. Simplicial 2-Complex Convolutional Neural Nets. Eric Bunch, Qian You, Glenn Fung, Vikas Singh. NeurIPS 2020 Workshop TDA and Beyond. Paper, Code

3. Cell complex neural networks. Mustafa Hajij, Kyle Istvan, and Ghada Zamzmi. NeurIPS Workshop on Topological Data Analysis and Beyond, 2020. Paper,

4. Principled simplicial neural networks for trajectory prediction. Roddenberry, T. Mitchell, Nicholas Glaze, and Santiago Segarra. ICML 2021. Paper, Code

5. Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networks. Cristian Bodnar, Fabrizio Frasca, Yu Guang Wang, Nina Otter, Guido Montúfar, Pietro Liò, Michael Bronstein. ICML 2021. Paper, Code ,

6. Weisfeiler and Lehman Go Cellular: CW Networks. Cristian Bodnar, Fabrizio Frasca, Nina Otter, Yu Guang Wang, Pietro Liò, Guido Montúfar, Michael Bronstein. NeurIPS 2021. Paper, Code ,

7. Simplicial Attention Neural Networks. Lorenzo Giusti, Claudio Battiloro, Paolo Di Lorenzo, Stefania Sardellitti, Sergio Barbarossa. arXiv 2022. Paper, Code

8. Simplicial Attention Networks. Christopher Wei Jin Goh, Cristian Bodnar, Pietro Liò. ICLR 2022 Workshop on Geometrical and Topological Representation Learning. Paper, Code

9. Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs. Cristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Liò, Michael M. Bronstein. NeurIPS 2022. Paper, Code ,

10. Simplicial Convolutional Neural Networks. Maosheng Yang, Elvin Isufi, Geert Leus. ICASSP 2022. Paper, Code

11. Sheaf Neural Networks with Connection Laplacians. Federico Barbero, Cristian Bodnar, Haitz Sáez de Ocáriz Borde, Michael Bronstein, Petar Veličković, Pietro Liò. ICML 2022 Workshop on Topology, Algebra, and Geometry in Machine Learning. Paper

12. Sheaf Attention Networks. Federico Barbero, Cristian Bodnar, Haitz Sáez de Ocáriz Borde, Pietro Liò. NeurIPS 2022 NeurReps Workshop. Paper

13. Cell Attention Networks. Lorenzo Giusti, Claudio Battiloro, Lucia Testa, Paolo Di Lorenzo, Stefania Sardellitti, Sergio Barbarossa. IEEE IJCNN 2023. Paper, Code

14. Surfing on the Neural Sheaf. Julian Suk, Lorenzo Giusti, Tamir Hemo, Miguel Lopez, Konstantinos Barmpas, Cristian Bodnar. NeurIPS 2022 NeurReps Workshop. Paper

15. Architectures of Topological Deep Learning: A Survey on Topological Neural Networks. Mathilde Papillon, Sophia Sanborn, Mustafa Hajij, Nina Miolane. Paper

16. Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Back. Claudio Battiloro, Zhiyang Wang, Hans Riess, Paolo Di Lorenzo, Alejandro Ribeiro. Paper, Code

17. Topological Graph Neural Networks. Max Horn, Edward De Brouwer, Michael Moor, Yves Moreau, Bastian Rieck, and Karsten Borgwardt. ICLR 2022. Paper, Code ,

18. Topological Autoencoders. Michael Moor, Max Horn, Bastian Rieck, and Karsten Borgwardt. ICML 2020. Paper, Code

19. E(n) Equivariant Message Passing Simplicial Networks. Floor Eijkelboom, Rob Hesselink, Erik Bekkers. ICML 2023. Paper

20. CIN++: Enhancing Topological Message Passing. Lorenzo Giusti, Teodora Reu, Francesco Ceccarelli, Cristian Bodnar, Pietro Liò. Paper, Code

21. Simplicial Hopfield networks. Thomas F Burns, Tomoki Fukai. ICLR 2023. Paper, Code,

22. Topological Deep Learning: Graphs, Complexes, Sheaves. Cristian Bodnar. Thesis

23. Weisfeiler and Lehman Go Paths: Learning Topological Features via Path Complexes. Quang Truong and Peter Chin. Paper

24. Generalized simplicial attention neural networks. Claudio Battiloro, Lucia Testa, Lorenzo Giusti, Stefania Sardellitti, Paolo Di Lorenzo, Sergio Barbarossa. Paper

25. TopoX: A Suite of Python Packages for Machine Learning on Topological Domains. Mustafa Hajij, Mathilde Papillon, Florian Frantzen et al. Paper, Code

26. Topological Neural Networks: Mitigating the Bottlenecks of Graph Neural Networks via Higher-Order Interactions. Lorenzo Giusti. Thesis

---

Topological Signal Processing

1. Topological signal processing over simplicial complexes. Sergio Barbarossa, Stefania Sardellitti. IEEE Transactions on Signal Processing 2020. Paper
2. Signal processing on higher-order networks: Livin’ on the edge... and beyond. Michael T. Schaub, Yu Zhu, Jean-Baptiste Seby, T. Mitchell Roddenberry, Santiago Segarra. Signal Processing, 2021 - Elsevier Paper
3. Hodge Laplacians on Graphs. Lek-Heng Lim. Society for Industrial and Applied Mathematics 2020. Paper
4. Random Walks on Simplicial Complexes and the normalized Hodge 1-Laplacian. Michael T. Schaub, Austin R. Benson, Paul Horn, Gabor Lippner, Ali Jadbabaie. SIAM 2020. Paper
5. What are higher-order networks? Christian Bick, Elizabeth Gross, Heather A. Harrington, Michael T. Schaub. arXiv 2021. Paper
6. Topological Signal Processing over Cell Complexes. Stefania Sardellitti, Sergio Barbarossa, Lucia Testa. arXiv 2021. Paper
7. Topological Signal Representation and Processing over Cell Complexes. Stefania Sardellitti, Sergio Barbarossa. arXiv 2022. Paper
8. Robust Signal Processing Over Simplicial Complexes. Stefania Sardellitti, Sergio Barbarossa. ICASSP 2022. Paper

---

Algebraic Topology

1. Computational and applied topology, tutorial. Paweł Dłotko. 2018. Paper
2. Algebraic topology. Allen Hatcher. Cambridge Univ. Press. 2000. Book
3. Cell Complexes through Time. Reinhard Klette. Vision Geometry 2000. Paper

---

Differential Geometry

1. Introduction to Differential Geometry. Joel W. Robbin, Dietmar A. Salamon. Book
2. Differential Geometry and Stochastic Dynamics with Deep Learning Numerics Line Kühnel, Alexis Arnaudon, and Stefan Sommer. arXiv 2017. Paper
3. Differential Geometry meets Deep Learning (DiffGeo4DL) Joey Bose · Emile Mathieu · Charline Le Lan · Ines Chami · Frederic Sala · Christopher De Sa · Maximilian Nickel · Christopher Ré · Will Hamilton. NeurIPS 2020 Workshop. Link

---

Discrete Calculus

1. Discrete Exterior Calculus. Anil N. Hirani. Caltech Library 2003. PhD Thesis

2. Discrete Calculus: Applied Analysis on Graphs for Computational Science. Leo J. Grady, Jonathan R. Polimeni. Springer 2010 . Book

3. Discrete Differential Forms for Computational Modeling. Mathieu Desbrun, Eva Kanso & Yiying Tong. SIGGRAPH 2006. Paper

---

Courses

1. Computational Algebraic Topology. Vidit Nanda. Website, Notes, Lectures

2. Discrete Differential Geometry. Keenan Crane. Website, Notes, Lectures

3. Shape Analysis. Justin Solomon. Website, Lectures

---

Blog

1. Learning on Topological Spaces: A new computational fabric for Graph Neural Networks. Michael Bronstein, Cristian Bodnar and Fabrizio Frasca. URL

---

Libraries

1. GUDHI: Geometry Understanding in Higher Dimensions. Website, Code, Tutorial
2. PyDEC: Software and Algorithms for Discretization of Exterior Calculus. Nathan Bell, Anil N. Hirani. 2011. Paper, Code