Scholarlink

The “pre-train & fine-tune” strategy has gained prominence in Graph Neural Networks (GNNs). During pre-training, the model learns from unlabeled data, and then it is fine-tuned using labeled data for specific tasks. However, full fine-tuning can be inefficient for large-scale models. To address this, we propose WAGT (Weight Adaptive module for Graph Tuning), which uses a ‘weight adaptive module’ inspired by synaptic modulation in the human brain, reducing fine-tuning parameters to just 0.7%. WAGT also includes an optimal transport-based regularizer for effective knowledge transfer. Experiments demonstrate WAGT’s efficiency and superior performance over existing methods.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Parameter Efficient Tuning for Graph Neural Networks via a Weight Adaptive Module

  • 会议论文

  • 发表日期：

    2025年

查看全文
  • Eunseon Seong,
  • Dong-Kyu Chae

摘要

The “pre-train & fine-tune” strategy has gained prominence in Graph Neural Networks (GNNs). During pre-training, the model learns from unlabeled data, and then it is fine-tuned using labeled data for specific tasks. However, full fine-tuning can be inefficient for large-scale models. To address this, we propose WAGT (Weight Adaptive module for Graph Tuning), which uses a ‘weight adaptive module’ inspired by synaptic modulation in the human brain, reducing fine-tuning parameters to just 0.7%. WAGT also includes an optimal transport-based regularizer for effective knowledge transfer. Experiments demonstrate WAGT’s efficiency and superior performance over existing methods.