A survey of compute nodes with 100 TFLOPS and beyond for supercomputers

With the Frontier supercomputer ranked first on the Top500 list, it marks the era of exascale computing power for supercomputers, employing the compute nodes with double-precision floating-point performance exceeding 100 TFLOPS. As the basic computing unit of supercomputers, the efficiency of compute nodes significantly impacts the processing efficiency of application workloads in different domains, such as scientific computing and artificial intelligence. This article systematically analyzes the architectures and key technologies of major supercomputers already built or soon to be constructed in the world, and summarizes the development trends of 100 TFLOPS compute nodes technology. This paper provides some valuable insights on how to address the challenges imposed by future 10-exascale and even zettascale supercomputers, which include improving energy efficiency, optimizing memory access, utilizing chiplet interconnection, and employing advanced packaging technology. This will help scholars in related fields to further think about future research directions, and help industrial employees to construct more practical and efficient compute nodes for the future supercomputers.