<p>Distributed learning is an effective method for solving large-scale cognitively inspired online machine learning problems. However, frequent communications between nodes lead to expensive communication burden. Meanwhile, projection operations because of the constraints in decision variables cause a lot of computational cost. In order to address the above problems, this paper presents a communication-efficient distributed Frank-Wolfe online optimization method, which integrates the event-triggered mechanism into the distributed projection-free online optimization algorithm. Furthermore, we provide a rigorous theoretical analysis for the regret of the proposed algorithm. Finally, we verify the performance of the proposed method through a variety of numerical experiments. The theoretical results show that the regret reaches a sublinear growth of iterations for convex objective functions. The proposed algorithm outperforms the baseline methods on two datasets. Our research indicates that, in addition to reducing computational overhead, the event-triggered scheme has the potential to enhance the communication efficiency of distributed network system.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Communication-Efficient Distributed Frank-Wolfe Online Algorithm with an Event-Triggered Mechanism

  • Huimin Gao,
  • Muhua Liu,
  • Zhihang Ji,
  • Ruijuan Zheng,
  • Qingtao Wu

摘要

Distributed learning is an effective method for solving large-scale cognitively inspired online machine learning problems. However, frequent communications between nodes lead to expensive communication burden. Meanwhile, projection operations because of the constraints in decision variables cause a lot of computational cost. In order to address the above problems, this paper presents a communication-efficient distributed Frank-Wolfe online optimization method, which integrates the event-triggered mechanism into the distributed projection-free online optimization algorithm. Furthermore, we provide a rigorous theoretical analysis for the regret of the proposed algorithm. Finally, we verify the performance of the proposed method through a variety of numerical experiments. The theoretical results show that the regret reaches a sublinear growth of iterations for convex objective functions. The proposed algorithm outperforms the baseline methods on two datasets. Our research indicates that, in addition to reducing computational overhead, the event-triggered scheme has the potential to enhance the communication efficiency of distributed network system.