The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows

  • Brian D. Etz,
  • David M. Rogers,
  • Michael J. Brim,
  • Ketan Maheshwari,
  • Kellen Leland,
  • Tyler J. Skluzacek,
  • Jack Lange,
  • Daniel Pelfrey,
  • Jordan Webb,
  • Patrick Widener,
  • Ryan Adamson,
  • Christopher Zimmer,
  • Verónica G. Melesse Vergara,
  • Mallikarjun Shankar,
  • Sarp Oral,
  • Rafael Ferreira da Silva

摘要

The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration.