Graph distillation has emerged as a solution for reducing large graph datasets to smaller, more manageable, and informative ones. Existing methods primarily target node classification, involve computationally intensive processes, and fail to capture the true distribution of the full graph dataset. To address these issues, we introduce Graph Distillation with Structural Attention Matching (GSTAM), a novel method for condensing graph classification datasets. GSTAM leverages the attention maps of GNNs to distill structural information from the original dataset into synthetic graphs. The structural attention-matching mechanism exploits the areas of the input graph that GNNs prioritize for classification, effectively distilling such information into the synthetic graphs and improving overall distillation performance. Comprehensive experiments demonstrate GSTAM’s superiority over existing methods, achieving \(0.45\%\) to \(6.5\%\) better performance in extreme condensation ratios, highlighting its potential use in advancing distillation for graph classification tasks (Code available at github.com/arashrasti96/GSTAM ).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GSTAM: Efficient Graph Distillation with Structural Attention-Matching

  • Arash Rasti-Meymandi,
  • Ahmad Sajedi,
  • Zhaopan Xu,
  • Konstantinos N. Plataniotis

摘要

Graph distillation has emerged as a solution for reducing large graph datasets to smaller, more manageable, and informative ones. Existing methods primarily target node classification, involve computationally intensive processes, and fail to capture the true distribution of the full graph dataset. To address these issues, we introduce Graph Distillation with Structural Attention Matching (GSTAM), a novel method for condensing graph classification datasets. GSTAM leverages the attention maps of GNNs to distill structural information from the original dataset into synthetic graphs. The structural attention-matching mechanism exploits the areas of the input graph that GNNs prioritize for classification, effectively distilling such information into the synthetic graphs and improving overall distillation performance. Comprehensive experiments demonstrate GSTAM’s superiority over existing methods, achieving \(0.45\%\) to \(6.5\%\) better performance in extreme condensation ratios, highlighting its potential use in advancing distillation for graph classification tasks (Code available at github.com/arashrasti96/GSTAM ).