Massively-parallel graph algorithms have received extensive attention over the past decade, with research focusing on three memory regimes: the superlinear regime, the near-linear regime, and the sublinear regime. The sublinear regime is the most desirable in practice, but conditional hardness results point towards its limitations. In this work we study a heterogeneous model, where the memory of the machines varies in size. We focus mostly on the heterogeneous setting created by adding a single near-linear machine to the sublinear MPC regime, and show that even a single large machine suffices to circumvent most of the conditional hardness results for the sublinear regime: for graphs with n vertices and m edges, we give (a) an MST algorithm that runs in <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="446_2025_479_Article_IEq1.gif" Format="GIF" Height="19" Rendition="HTML" Resolution="72" Type="Linedraw" Width="116" /> </InlineMediaObject> <EquationSource Format="TEX">$O(\log \log (m/n))$</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>O</mi> <mo stretchy="false">(</mo> <mo>log</mo> <mo>log</mo> <mo stretchy="false">(</mo> <mi>m</mi> <mo stretchy="false">/</mo> <mi>n</mi> <mo stretchy="false">)</mo> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> rounds; (b) an algorithm that constructs an O(k)-spanner of size <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="446_2025_479_Article_IEq2.gif" Format="GIF" Height="21" Rendition="HTML" Resolution="72" Type="Linedraw" Width="71" /> </InlineMediaObject> <EquationSource Format="TEX">$O(n^{1+1/k})$</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>O</mi> <mo stretchy="false">(</mo> <msup> <mi>n</mi> <mrow> <mn>1</mn> <mo>+</mo> <mn>1</mn> <mo stretchy="false">/</mo> <mi>k</mi> </mrow> </msup> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> in O(1) rounds; and (c) a maximal-matching algorithm that runs in <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="446_2025_479_Article_IEq3.gif" Format="GIF" Height="22" Rendition="HTML" Resolution="72" Type="Linedraw" Width="202" /> </InlineMediaObject> <EquationSource Format="TEX">$O(\sqrt{\log (m/n)}\log \log (m/n))$</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>O</mi> <mo stretchy="false">(</mo> <msqrt> <mrow> <mo>log</mo> <mo stretchy="false">(</mo> <mi>m</mi> <mo stretchy="false">/</mo> <mi>n</mi> <mo stretchy="false">)</mo> </mrow> </msqrt> <mo>log</mo> <mo>log</mo> <mrow> <mo stretchy="false">(</mo> <mi>m</mi> <mo stretchy="false">/</mo> <mi>n</mi> <mo stretchy="false">)</mo> </mrow> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> rounds. We also observe that the best known near-linear MPC algorithms for several other graph problems which are conjectured to be hard in the sublinear regime (minimum cut, maximal independent set, and vertex coloring) can easily be transformed to work in the heterogeneous MPC model with a single near-linear machine, while retaining their original round complexity in the near-linear regime. If the large machine is allowed to have superlinear memory, all of the problems above can be solved in O(1) rounds.

Massively parallel computation in a heterogeneous regime

期刊论文
出版模式：

开放获取
发表日期：

2025年3月26日

查看全文

Orr Fischer,
Adi Horowitz,
Rotem Oshman

摘要

Massively-parallel graph algorithms have received extensive attention over the past decade, with research focusing on three memory regimes: the superlinear regime, the near-linear regime, and the sublinear regime. The sublinear regime is the most desirable in practice, but conditional hardness results point towards its limitations. In this work we study a heterogeneous model, where the memory of the machines varies in size. We focus mostly on the heterogeneous setting created by adding a single near-linear machine to the sublinear MPC regime, and show that even a single large machine suffices to circumvent most of the conditional hardness results for the sublinear regime: for graphs with n vertices and m edges, we give (a) an MST algorithm that runs in $O(\log \log (m/n))$ $O (log log (m / n))$ rounds; (b) an algorithm that constructs an O(k)-spanner of size $O(n^{1+1/k})$ $O (n^{1 + 1 / k})$ in O(1) rounds; and (c) a maximal-matching algorithm that runs in $O(\sqrt{\log (m/n)}\log \log (m/n))$ $O (\sqrt{log (m / n)} log log (m / n))$ rounds. We also observe that the best known near-linear MPC algorithms for several other graph problems which are conjectured to be hard in the sublinear regime (minimum cut, maximal independent set, and vertex coloring) can easily be transformed to work in the heterogeneous MPC model with a single near-linear machine, while retaining their original round complexity in the near-linear regime. If the large machine is allowed to have superlinear memory, all of the problems above can be solved in O(1) rounds.