Application I/O behavior analysis on leadership cluster system
摘要
A parallel file system is essential for executing large workloads via large-scale computing resources such as national leadership computers; however, a primary cause of performance degradation arises from I/O operation. In the scientific workloads, there is often a significant variance in I/O performance, and the information needed to determine the characteristics of the tasks is limited at the time of job submission. These characteristics make it very difficult to analyze and predict I/O performance. Nevertheless, accurate analysis of the I/O behavior of applications based on multidimensional logs greatly aids in overcoming these challenges. In this paper, we examine in detail the relationship between applications and I/O behavior on the basis of multiple logs from jobs executed on the national leadership computer