Skip to content

zhilonglu/Graph-Neural-Network

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

47 Commits
 
 

Repository files navigation

Graph-Neural-Networks

All materials related to GNN

Related survey papers

  • Deep Learning on Graphs: A Survey, arXiv 2018
  • A Comprehensive Survey on Graph Neural Networks,arXiv 2018
  • Graph Neural Networks: A Review of Methods and Applications,arXiv 2018
  • Relational inductive biases, deep learning, and graph networks,arXiv 2018

Motivation of GNN

  • The first motivation of GNNs roots in convolutional neural networks (CNNs)
  • The other motivation comes from graph embedding, which learns to represent graph nodes, edges or subgraphs in low-dimensional vectors.

GNN worth investigating

  • GNNs propagate on each node respectively, ignoring the input order of nodes
  • GNNs can do propagation guided by the graph structure instead of using it as part of features
  • GNNs explore to generate the graph from non structural data like scene pictures and story documents, which can be a powerful neural model for further high-level AI.

Challenges of traditional deep learning on graphs

  • Irregular domain
  • Varying structures and tasks
  • Scalability and parallelization
  • Interdiscipline

General Frameworks

  • Message Passing Neural Networks(MPNN)
  • Non-local Neural Networks(NLNN)
  • Graph Networks(GN)

Taxonomy of Deep Learning methods on graphs

  • Graph Neural Networks
  • Graph Convolutional Networks
    • Spectral-based
    • Spatial-based
    • Pooling modules
  • Graph Auto-encoders
    • Auto-encoders
    • Variational Auto-encoders
  • Graph Attention Networks
  • Graph Generative Networks
  • Graph Spatial-Temporal Networks
  • Graph Recurrent Neural Networks
  • Graph Reinforcement Learning

Datasets

  • Citation Networks
    • Cora (Collective classification in network data,AI magazine,2008)
    • Citeseer (Collective classification in network data,AI magazine,2008)
    • Pubmed (Collective classification in network data,AI magazine,2008)
    • DBLP
  • Social Networks
    • BlogCatalog (Relational learning via latent social dimensions,KDD 2009)
    • Reddit (representation learning on large graphs,NIPS 2017)
    • Epinions
  • Chemical/Biological Graphs
    • PPI (Predicting multicellular function through multi-layer tissue networks,Bioinformatics 2017)
    • NCI-1 (Comparison of descriptor spaces for chemical compound retrieval and classification,KIS 2008)
    • NCI-109 (Comparison of descriptor spaces for chemical compound retrieval and classification,KIS 2008)
    • MUTAG (Structure-activity relationship of mutagenic aromatic and heteroaromatic nitro compounds. correlation with molecular orbital energies and hydrophobicity,Journal of medicinal chemistry,1991)
    • D&D (Distinguishing enzyme structures from non-enzymes without alignments,Journal of molecular biology 2003)
    • QM9 (Quantum chemistry structures and properties of 134 kilo molecules,Scientific data 2014)
    • tox21
  • Unstructured Graphs
    • MNIST
    • Wikipedia
    • 20NEWS (A probabilistic analysis of the rocchio algorithm with tfidf for text categorization.Carnegie-mellon univ pittsburgh pa dept of computer science, Tech. Rep., 1996)
  • Others
    • METR-LA (Big data and its technical challenges,Communications of the ACM 2014)
    • Movie-Lens1M
    • Nell (Toward an architecture for never-ending language learning,AAAI 2010)

Open-source Implementations

Platform

Applications

Future directions

  • Different types of graphs
  • Dynamic graphs
  • Interpretability
  • Compositionality
  • Go Deep
  • Receptive Field
  • Scalability
  • Shallow Structure(graph neural net works are always shallow, most of which are no more than three layers.)
  • Non-Structural Scenarios
  • Green deep learning
  • Low resource learning(FSL and ZSL)

GNN application for specific field

some related resources

Researchers and Groups

About

All materials related to GNN

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published