Graph Transformer (GT) models have demonstrated superior performance in various graph-related tasks due to their ability to model long-range node dependencies. However, current GT-based methods are constrained by low-dimensional node attributes and insufficient exploitation of global graph structure, leaving their feature embedding space underexplored. In this study, we propose a Feature Expansion based Graph Transformer (FEGT) for effective graph data processing, aiming to improve node classification accuracy. FEGT integrates node, edge, and structural embeddings to extend the original feature space of Graph Transformers, employing a fusion architecture that combines message-passing mechanisms and Transformer modules for node and edge feature extraction. Importantly, we capture structural information by decomposing the graph adjacency matrix and extracting principal component features, which are incorporated into the feature space as structural embeddings. We present numerical experiments on benchmark graph datasets (Cora, Citeseer, Pubmed, PATTERN, CLUSTER) to verify the effectiveness of FEGT. The results demonstrate that FEGT achieves superior performance in node classification compared to seven competitive models (GCN, GIN, GAT, GatedGCN, SAN, GT, GPS). Ablation studies further validate the effectiveness of the feature expansion with structural embeddings.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Feature Expansion Based Graph Transformer for Node Classification

  • Yun Chen,
  • Canxin Chen,
  • Jiaqing Tong,
  • Xiangyuan Ma

摘要

Graph Transformer (GT) models have demonstrated superior performance in various graph-related tasks due to their ability to model long-range node dependencies. However, current GT-based methods are constrained by low-dimensional node attributes and insufficient exploitation of global graph structure, leaving their feature embedding space underexplored. In this study, we propose a Feature Expansion based Graph Transformer (FEGT) for effective graph data processing, aiming to improve node classification accuracy. FEGT integrates node, edge, and structural embeddings to extend the original feature space of Graph Transformers, employing a fusion architecture that combines message-passing mechanisms and Transformer modules for node and edge feature extraction. Importantly, we capture structural information by decomposing the graph adjacency matrix and extracting principal component features, which are incorporated into the feature space as structural embeddings. We present numerical experiments on benchmark graph datasets (Cora, Citeseer, Pubmed, PATTERN, CLUSTER) to verify the effectiveness of FEGT. The results demonstrate that FEGT achieves superior performance in node classification compared to seven competitive models (GCN, GIN, GAT, GatedGCN, SAN, GT, GPS). Ablation studies further validate the effectiveness of the feature expansion with structural embeddings.