| 整理:潘润琦
| 链接:zhuanlan.zhihu.com/p/464093894
| 转自:深度学习与图网络
今年的ICLR录取结果出了,图神经网络也是今年的一大热点,这里总结一部分看到的GNN的文章,如果有错误的或者遗漏的文章请大家一定指出来。https://github.com/naganandy/graph-based-deep-learning-literature/blob/master/conference-publications/folders/publications_iclr22/README.md## Baseline and Benchmark
Graph-less Neural Networks: Teaching Old MLPs New Tricks Via Distillation Shichang Zhang, Yozen Liu, Yizhou Sun, Neil ShahEvaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions Leslie O'Bray, Max Horn, Bastian Rieck, Karsten BorgwardtGNN is a Counter? Revisiting GNN for Question Answering Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao QinRethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework Xu Ma, Can Qin, Haoxuan You, Haoxi Ran, Yun Fu## GNN理论
A New Perspective on "How Graph Neural Networks Go Beyond Weisfeiler-Lehman?" Asiri Wijesinghe, Qing WangFrame Averaging for Invariant and Equivariant Network Design Omri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra, Aditya Grover, Heli Ben-Hamu, Yaron LipmanEquivariant Subgraph Aggregation Networks Beatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan, Chen Cai, Gopinath Balamurugan, Michael M. Bronstein, Haggai MaronUnderstanding over-squashing and bottlenecks on graphs via curvature Jake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong, Michael M. BronsteinExpressiveness and Approximation Properties of Graph Neural Networks Floris Geerts, Juan L ReutterHow Attentive are Graph Attention Networks? Shaked Brody, Uri Alon, Eran YahavFrom Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness Lingxiao Zhao, Wei Jin, Leman Akoglu, Neil ShahIs Homophily a Necessity for Graph Neural Networks? Yao Ma, Xiaorui Liu, Neil Shah, Jiliang TangPF-GNN: Differentiable particle filtering based approximation of universal graph representations Mohammed Haroon Dupty, Yanfei Dong, Wee Sun LeeDo We Need Anisotropic Graph Neural Networks? Shyam A. Tailor, Felix Opolka, Pietro Lio, Nicholas Donald LaneLEARNING GUARANTEES FOR GRAPH CONVOLUTIONAL NETWORKS ON THE STOCHASTIC BLOCK MODEL Wei LuTriangle and Four Cycle Counting with Predictions in Graph Streams Justin Y Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael ZhangEquivariant and Stable Positional Encoding for More Powerful Graph Neural Networks Haorui Wang, Haoteng Yin, Muhan Zhang, Pan LiWhy Propagate Alone? Parallel Use of Labels and Features on Graphs Yangkun Wang, Jiarui Jin, Weinan Zhang, Yang Yongyi, Jiuhai Chen, Quan Gan, Yong Yu, Zheng Zhang, Zengfeng Huang, David WipfYou are AllSet: A Multiset Function Framework for Hypergraph Neural Networks Eli Chien, Chao Pan, Jianhao Peng, Olgica MilenkovicRevisiting Over-smoothing in BERT from the Perspective of Graph Han Shi, JIAHUI GAO, Hang Xu, Xiaodan Liang, Zhenguo Li, Lingpeng Kong, Stephen M. S. Lee, James KwokThe Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks Rahim Entezari, Hanie Sedghi, Olga Saukh, Behnam Neyshabur## 新的GNN结构
Convergent Graph Solvers Junyoung Park, Jinhyun Choo, Jinkyoo ParkEquivariant Subgraph Aggregation Networks Beatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan, Chen Cai, Gopinath Balamurugan, Michael M. Bronstein, Haggai MaronNeural Structured Prediction for Inductive Node Classification Meng Qu, Huiyu Cai, Jian TangGeometric and Physical Quantities improve E(3) Equivariant Message Passing Johannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J Bekkers, Max WellingTopological Graph Neural Networks Max Horn, Edward De Brouwer, Michael Moor, Yves Moreau, Bastian Rieck, Karsten BorgwardtGRAND++: Graph Neural Diffusion with A Source Term Matthew Thorpe, Tan Minh Nguyen, Hedi Xia, Thomas Strohmer, Andrea Bertozzi, Stanley Osher, Bao WangGraph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, Xavier Bresson## Deep GNN
Towards Deepening Graph Neural Networks: A GNTK-based Optimization Perspective Wei Huang, Yayong Li, weitao Du, Richard Xu, Jie Yin, Ling Chen, Miao Zhang## Data Augmentation
Graph Condensation for Graph Neural Networks Wei Jin, Lingxiao Zhao, Shichang Zhang, Yozen Liu, Jiliang Tang, Neil Shah## GNN训练
PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication Cheng Wan, Youjie Li, Cameron R. Wolfe, Anastasios Kyrillidis, Nam Sung Kim, Yingyan LinIGLU: Efficient GCN Training via Lazy Updates S Deepak Narayanan, Aditya Sinha, Prateek Jain, Purushottam Kar, SUNDARARAJAN SELLAMANICKAMLearning to Schedule Learning rate with Graph Neural Networks Yuanhao Xiong, Li-Cheng Lan, Xiangning Chen, Ruochen Wang, Cho-Jui HsiehTowards Training Billion Parameter Graph Neural Networks for Atomic Simulations Anuroop Sriram, Abhishek Das, Brandon M Wood, C. Lawrence ZitnickEXACT: Scalable Graph Neural Networks Training via Extreme Activation Compression Zirui Liu, Kaixiong Zhou, Fan Yang, Li Li, Rui Chen, Xia HuLearn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks Morteza Ramezani, Weilin Cong, Mehrdad Mahdavi, Mahmut Kandemir, Anand SivasubramaniamLarge-Scale Representation Learning on Graphs via Bootstrapping Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Mehdi Azabou, Eva L Dyer, Remi Munos, Petar Veličković, Michal Valko## 自监督
Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis Siyi Tang, Jared Dunnmon, Khaled Kamal Saab, Xuan Zhang, Qianying Huang, Florian Dubost, Daniel Rubin, Christopher Lee-MesserPre-training Molecular Graph Representation with 3D Geometry Shengchao Liu, Hanchen Wang, Weiyang Liu, Joan Lasenby, Hongyu Guo, Jian TangNode Feature Extraction by Self-Supervised Multi-scale Neighborhood Prediction Eli Chien, Wei-Cheng Chang, Cho-Jui Hsieh, Hsiang-Fu Yu, Jiong Zhang, Olgica Milenkovic, Inderjit S DhillonAutomated Self-Supervised Learning for Graphs Wei Jin, Xiaorui Liu, Xiangyu Zhao, Yao Ma, Neil Shah, Jiliang Tang## 可解释性&因果
Discovering Invariant Rationales for Graph Neural Networks Yingxin Wu, Xiang Wang, An Zhang, Xiangnan He, Tat-Seng ChuaExplanations of Black-Box Models based on Directional Feature Interactions Aria Masoomi, Davin Hill, Zhonghui Xu, Craig P Hersh, Edwin K. Silverman, Peter J. Castaldi, Stratis Ioannidis, Jennifer DyDEGREE: Decomposition Based Explanation for Graph Neural Networks Qizhang Feng, Ninghao Liu, Fan Yang, Ruixiang Tang, Mengnan Du, Xia HuA Biologically Interpretable Graph Convolutional Network to Link Genetic Risk Pathways and Imaging Phenotypes of Disease Sayan Ghosal, Qiang Chen, Giulio Pergola, Aaron L Goldman, William Ulrich, Daniel R Weinberger, Archana VenkataramanExplainable GNN-Based Models over Knowledge Graphs David Jaime Tena Cucala, Bernardo Cuenca Grau, Egor V. Kostylev, Boris MotikEfficient Neural Causal Discovery without Acyclicity Constraints Phillip Lippe, Taco Cohen, Efstratios Gavves## 图生成
Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Design Wenhao Gao, Rocío Mercado, Connor W. ColeyIterative Refinement Graph Neural Network for Antibody Sequence-Structure Co-design Wengong Jin, Jeremy Wohlwend, Regina Barzilay, Tommi S. JaakkolaData-Efficient Graph Grammar Learning for Molecular Generation Minghao Guo, Veronika Thost, Beichen Li, Payel Das, Jie Chen, Wojciech MatusikEvaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions Leslie O'Bray, Max Horn, Bastian Rieck, Karsten BorgwardtGeoDiff: A Geometric Diffusion Model for Molecular Conformation Generation Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, Jian TangGraph Auto-Encoder via Neighborhood Wasserstein Reconstruction Mingyue Tang, Pan Li, Carl YangGraphENS: Neighbor-Aware Ego Network Synthesis for Class-Imbalanced Node Classification Joonhyung Park, Jaeyun Song, Eunho YangTop-N: Equivariant Set and Graph Generation without Exchangeability Clement Vignac, Pascal FrossardDifferentiable Scaffolding Tree for Molecule Optimization Tianfan Fu, Wenhao Gao, Cao Xiao, Jacob Yasonik, Connor W. Coley, Jimeng SunLearning to Extend Molecular Scaffolds with Structural Motifs Krzysztof Maziarz, Henry Richard Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc BrockschmidtVitruvion: A Generative Model of Parametric CAD Sketches Ari Seff, Wenda Zhou, Nick Richardson, Ryan P Adams## 组合优化
Graph Neural Network Guided Local Search for the Traveling Salesperson Problem Benjamin Hudson, Qingbiao Li, Matthew Malencia, Amanda ProrokNeural Models for Output-Space Invariance in Combinatorial Problems Yatin Nandwani, Vidit Jain, Mausam ., Parag SinglaWhat’s Wrong with Deep Learning in Tree Search for Combinatorial Optimization Maximilian Böther, Otto Kißig, Martin Taraz, Sarel Cohen, Karen Seidel, Tobias FriedrichLearning Scenario Representation for Solving Two-stage Stochastic Integer Programs Yaoxin Wu, Wen Song, Zhiguang Cao, Jie Zhang## 物理
Constrained Graph Mechanics Networks Wenbing Huang, Jiaqi Han, Yu Rong, Tingyang Xu, Fuchun Sun, Junzhou HuangLearning the Dynamics of Physical Systems from Sparse Observations with Finite Element Networks Marten Lienen, Stephan GünnemannR5: Rule Discovery with Reinforced and Recurrent Relational Reasoning Shengyao Lu, Bang Liu, Keith G Mills, SHANGLING JUI, Di NiuAb-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions Nicholas Gao, Stephan GünnemannMessage Passing Neural PDE Solvers Johannes Brandstetter, Daniel E. Worrall, Max WellingConstrained Graph Mechanics Networks Wenbing Huang, Jiaqi Han, Yu Rong, Tingyang Xu, Fuchun Sun, Junzhou HuangTowards Training Billion Parameter Graph Neural Networks for Atomic Simulations Anuroop Sriram, Abhishek Das, Brandon M Wood, C. Lawrence ZitnickNeural Relational Inference with Node-Specific Information Ershad BanijamaliPredicting Physics in Mesh-reduced Space with Temporal Attention XU HAN, Han Gao, Tobias Pfaff, Jian-Xun Wang, Liping Liu## 生物&化学
Iterative Refinement Graph Neural Network for Antibody Sequence-Structure Co-designWengong Jin, Jeremy Wohlwend, Regina Barzilay, Tommi S. JaakkolaSelf-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis Siyi Tang, Jared Dunnmon, Khaled Kamal Saab, Xuan Zhang, Qianying Huang, Florian Dubost, Daniel Rubin, Christopher Lee-MesserSpanning Tree-based Graph Generation for Molecules Sungsoo Ahn, Binghong Chen, Tianzhe Wang, Le SongGeoDiff: A Geometric Diffusion Model for Molecular Conformation Generation Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, Jian TangIndependent SE(3)-Equivariant Models for End-to-End Rigid Protein Docking Octavian-Eugen Ganea, Xinyuan Huang, Charlotte Bunne, Yatao Bian, Regina Barzilay, Tommi S. Jaakkola, Andreas KrauseSpatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery Yulun Wu, Nicholas Choma, Andrew Deru Chen, Mikaela Cashman, Erica Teixeira Prates, Veronica G Melesse Vergara, Manesh B Shah, Austin Clyde, Thomas Brettin, Wibe Albert de Jong, Neeraj Kumar, Martha S Head, Rick L. Stevens, Peter Nugent, Daniel A Jacobson, James B BrownUsing Graph Representation Learning with Schema Encoders to Measure the Severity of Depressive Symptoms Simin Hong, Anthony Cohn, David Crossland HoggA Biologically Interpretable Graph Convolutional Network to Link Genetic Risk Pathways and Imaging Phenotypes of Disease Sayan Ghosal, Qiang Chen, Giulio Pergola, Aaron L Goldman, William Ulrich, Daniel R Weinberger, Archana VenkataramanSimple GNN Regularisation for 3D Molecular Property Prediction and Beyond Jonathan Godwin, Michael Schaarschmidt, Alexander L Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter BattagliaGeometric Transformers for Protein Interface Contact Prediction Alex Morehead, Chen Chen, Jianlin ChengOntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang, Zhen Bi, Xiaozhuan Liang, Siyuan Cheng, Haosen Hong, Shumin Deng, Qiang Zhang, Jiazhang Lian, Huajun ChenLearning 3D Representations of Molecular Chirality with Invariance to Bond Rotations Keir Adams, Lagnajit Pattanaik, Connor W. ColeyChemical-Reaction-Aware Molecule Representation Learning Hongwei Wang, Weijiang Li, Xiaomeng Jin, Kyunghyun Cho, Heng Ji, Jiawei Han, Martin BurkeSpherical Message Passing for 3D Molecular Graphs Yi Liu, Limei Wang, Meng Liu, Yuchao Lin, Xuan Zhang, Bora Oztekin, Shuiwang Ji## 时间序列
Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series Enyan Dai, Jie ChenTAMP-S2GCNets: Coupling Time-Aware Multipersistence Knowledge Representation with Spatio-Supra Graph Convolutional Networks for Time-Series Forecasting Yuzhou Chen, Ignacio Segovia-Dominguez, Baris Coskunuzer, Yulia GelSpace-Time Graph Neural Networks Samar Hadou, Charilaos I Kanatsoulis, Alejandro RibeiroFilling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks Andrea Cini, Ivan Marisca, Cesare AlippiGraph-Guided Network for Irregularly Sampled Multivariate Time Series Xiang Zhang, Marko Zeman, Theodoros Tsiligkaridis, Marinka ZitnikLearning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecasting Hyunwook Lee,Seungmin Jin,Hyeshin Chu,Hongkyu Lim,Sungahn Ko## Multi-agent
Context-Aware Sparse Deep Coordination Graphs Tonghan Wang, Liang Zeng, Weijun Dong, Qianlan Yang, Yang Yu, Chongjie ZhangReinforcement Learning under a Multi-agent Predictive State Representation Model: Method and Theory Zhi Zhang, Zhuoran Yang, Han Liu, Pratap Tokekar, Furong HuangLearning Graphon Mean Field Games and Approximate Nash Equilibria Kai Cui, Heinz KoepplGraph-Enhanced Exploration for Goal-oriented Reinforcement Learning Jiarui Jin, Sijin Zhou, Weinan Zhang, Tong He, Yong Yu, Rasool FakoorStructure-Aware Transformer Policy for Inhomogeneous Multi-Task Reinforcement Learning Sunghoon Hong, Deunsol Yoon, Kee-Eung KimC-Planning: An Automatic Curriculum for Learning Goal-Reaching Tasks Tianjun Zhang, Benjamin Eysenbach, Ruslan Salakhutdinov, Sergey Levine, Joseph E. GonzalezLearning Object-Oriented Dynamics for Planning from Text Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart## Relation Modeling & Extraplation
Relational Multi-Task Learning: Modeling Relations between Data and Tasks Kaidi Cao, Jiaxuan You, Jure LeskovecInductive Relation Prediction Using Analogy Subgraph Embeddings Jiarui Jin, Yangkun Wang, Kounianhua Du, Weinan Zhang, Zheng Zhang, David Wipf, Yong Yu, Quan GanAda-NETS: Face Clustering via Adaptive Neighbour Discovery in the Structure Space Yaohua Wang, Yaobin Zhang, Fangyi Zhang, Senzhang Wang, Ming Lin, YuQi Zhang, Xiuyu SunGraph-Relational Domain Adaptation Zihao Xu, Hao He, Guang-He Lee, Bernie Wang, Hao WangTowards Distribution Shift of Node-Level Prediction on Graphs: An Invariance Perspective Qitian Wu, Hengrui Zhang, Junchi Yan, David WipfMoReL: Multi-omics Relational Learning Arman Hasanzadeh, Ehsan Hajiramezanali, Nick Duffield, Xiaoning QianKnow Your Action Set: Learning Action Relations for Reinforcement Learning Ayush Jain, Norio Kosaka, Kyung-Min Kim, Joseph J Lim## Transformer
Revisiting Over-smoothing in BERT from the Perspective of Graph Han Shi, JIAHUI GAO, Hang Xu, Xiaodan Liang, Zhenguo Li, Lingpeng Kong, Stephen M. S. Lee, James Kwok## Tabular Data
Convergent Boosted Smoothing for Modeling GraphData with Tabular Node Features Jiuhai Chen, Jonas Mueller, Vassilis N. Ioannidis, Soji Adeshina, Yangkun Wang, Tom Goldstein, David Wipf## NLP
GreaseLM: Graph REASoning Enhanced Language Models Xikun Zhang, Antoine Bosselut, Michihiro Yasunaga, Hongyu Ren, Percy Liang, Christopher D Manning, Jure LeskovecGNN-LM: Language Modeling based on Global Contexts via GNN Yuxian Meng, Shi Zong, Xiaoya Li, Xiaofei Sun, Tianwei Zhang, Fei Wu, Jiwei Li## Robustness
Understanding and Improving Graph Injection Attack by Promoting Unnoticeability Yongqiang Chen, Han Yang, Yonggang Zhang, MA KAILI, Tongliang Liu, Bo Han, James ChengAdversarial Robustness Through the Lens of Causality Yonggang Zhang, Mingming Gong, Tongliang Liu, Gang Niu, Xinmei Tian, Bo Han, Bernhard Schölkopf, Kun Zhang## 其它
Information Gain Propagation: a New Way to Graph Active Learning with Soft Labels Wentao Zhang, Yexin Wang, Zhenbang You, Meng Cao, Ping Huang, Jiulong Shan, Zhi Yang, Bin CUIEnd-to-End Learning of Probabilistic Hierarchies on Graphs Daniel Zügner, Bertrand Charpentier, Morgane Ayle, Sascha Geringer, Stephan GünnemannCold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods Wenqing Zheng, Edward W Huang, Nikhil Rao, Sumeet Katariya, Zhangyang Wang, Karthik SubbianRetriever: Learning Content-Style Representation as a Token-Level Bipartite Graph Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun ZengNeural Link Prediction with Walk Pooling Liming Pan, Cheng Shi, Ivan DokmanićGLASS: GNN with Labeling Tricks for Subgraph Representation Learning Xiyuan Wang, Muhan ZhangNodePiece: Compositional and Parameter-Efficient Representations of Large Knowledge Graphs Mikhail Galkin, Etienne Denis, Jiapeng Wu, William L. HamiltonQuery Embedding on Hyper-Relational Knowledge Graphs Dimitrios Alivanistos, Max Berrendorf, Michael Cochez, Mikhail Galkin