A data management architecture for Major Atmospheric Cherenkov Experiment : MACE-DMS
摘要
In this digital era, the generation of data is occurring at an unprecedented rate across diverse fields, and scientific experiments are no exception. These experiments often generate massive volumes of data that require robust and efficient data management. Addressing challenges such as data archiving, backup, retrieval, and analysis are critical for ensuring the usability,longevity, and security of scientific datasets. In this paper, we present the design of a Data Management System (DMS) tailored to meet the unique requirements and complexities of a Very High Energy (VHE) ground-based gamma-ray experiment. We describe both the high-level design and low-level implementation details of the data management architecture developed for the Major Atmospheric Cherenkov Experiment (MACE). This architecture incorporates scalable storage solutions, advanced data retrieval mechanisms, and efficient analysis pipelines to support real-time processing and long-term data preservation. In addition, we present an overview of MACE observational data, storage patterns, and system performance in terms of data handling, demonstrating how DMS has effectively addressed all aspects of data management.