High-order graph attention network

Liancheng He, Liang Bai, Xian Yang, Huangyuan Du, Jiye Liang

Research output: Contribution to journalArticlepeer-review

20 Downloads (Pure)

Abstract

GCN is a widely-used representation learning method for capturing hidden features in graph data. However, traditional GCNs suffer from the oversmoothing problem, hindering their ability to extract high-order information and obtain robust data representation. To overcome this limitation, we propose a novel graph model, the high-order graph attention network. Compared to other existing graph attention networks, our model can adaptively aggregate node features from multi-hop neighbors through an attention mechanism. Moreover, the edges in the original graph may not accurately represent the relationships between nodes. We implement a new approach to update the graph by using the aggregated node representation to adjust the edges with small step sizes. Additionally, we perform a theoretical analysis to demonstrate the relationships between our proposed model and other GCN models. Finally, we evaluate our proposed model against eight variants of GCN models on multiple widely-used benchmark datasets. The experimental results show the superiority of our proposed model over other models.
Original languageEnglish
JournalInformation Sciences
Volume630
Early online date15 Feb 2023
DOIs
Publication statusPublished - 1 Jun 2023

Keywords

  • Graph neural network
  • graph convolutional network
  • attention mechanism
  • high-order information

Fingerprint

Dive into the research topics of 'High-order graph attention network'. Together they form a unique fingerprint.

Cite this