<p>The Sequential Task Flow (STF) model guides task parallelism by dynamically analyzing data dependencies at runtime, making it well-suited to handle dynamic and irregular parallelism. However, it introduces additional dependency tracking overhead. As task granularity becomes increasingly fine-grained or hardware parallelism increases, the traditional Centralized TDG Building (CB) algorithm progressively becomes a performance bottleneck. The Parallel TDG Building algorithm with Helpers (PBH), which leverages hardware message-passing mechanisms, has achieved significant speedups on the SW26010 platform, but its intensive sub-microsecond irregular synchronizations make it difficult to scale on cache-coherent multicore platforms. This paper proposes Cache-friendly PBH (CPBH), a parallel dependency tracking algorithm optimized for cache-coherent architectures. CPBH introduces a locality-aware lock-free batch synchronization mechanism that reduces the overhead of atomic operation contention and improves data access locality. Additionally, it employs an asynchronous execution strategy to overlap dependency tracking and task graph execution using dynamic reference counting. Experiments on three cache-coherent multicore platforms using 10 HPC benchmarks demonstrate that CPBH achieves an average speedup exceeding 1.4 × compared to CB and over 1.2 × speedup compared to DDAST under fine-grained scenarios.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving scalability of sequential task flow models with cache-friendly parallel dependency tracking

  • Xiran Gao,
  • Li Chen,
  • Xiaobing Feng

摘要

The Sequential Task Flow (STF) model guides task parallelism by dynamically analyzing data dependencies at runtime, making it well-suited to handle dynamic and irregular parallelism. However, it introduces additional dependency tracking overhead. As task granularity becomes increasingly fine-grained or hardware parallelism increases, the traditional Centralized TDG Building (CB) algorithm progressively becomes a performance bottleneck. The Parallel TDG Building algorithm with Helpers (PBH), which leverages hardware message-passing mechanisms, has achieved significant speedups on the SW26010 platform, but its intensive sub-microsecond irregular synchronizations make it difficult to scale on cache-coherent multicore platforms. This paper proposes Cache-friendly PBH (CPBH), a parallel dependency tracking algorithm optimized for cache-coherent architectures. CPBH introduces a locality-aware lock-free batch synchronization mechanism that reduces the overhead of atomic operation contention and improves data access locality. Additionally, it employs an asynchronous execution strategy to overlap dependency tracking and task graph execution using dynamic reference counting. Experiments on three cache-coherent multicore platforms using 10 HPC benchmarks demonstrate that CPBH achieves an average speedup exceeding 1.4 × compared to CB and over 1.2 × speedup compared to DDAST under fine-grained scenarios.