Unified Collection System with High-Performance for Multi-source Heterogeneous Energy Efficiency Data

In the face of the national “double carbon” strategic goal, major operators, major equipment manufacturers and professional vendors have developed various energy saving algorithm models and application services, and the quality and availability of the underlying data is the key to the success of these models and services in the overall energy saving system. Given the characteristics of a variety of data involved in the energy saving system, such as cross-discipline and heterogeneity, this paper proposes a unified data collection framework and system that meets the requirements of large-scale data collection such as high reliability, high availability and high concurrency, while supporting on-demand access of third-party collection adapters with strong scalability. The pilot application results of this system show that this system can make better use of server hardware resources and significantly reduce the end-to-end latency of data collection in the high-volume data collection scenario.