Design of Data Management System for Sustainable Development of Urban Agglomerations’ Ecological Environment Based on Data Lake Architecture

Research on the ecological environment of urban agglomerations plays a crucial role in enhancing environmental quality and ensuring sustainable development. In the research of sustainable development-oriented monitoring and assessing for ecological environments, the management and provision of data have gained significant prominence. However, the characteristics of vast data volumes, diverse data types, and inconsistent metadata descriptions hinder the comprehensive management of ecological environment data in urban agglomerations. This paper aims to investigate the data requirements that are necessary for sustainable development, with a particular focus on unified data management, online data product production and updates, and data service provision. To address these challenges, we have designed a metadata model that is capable of accommodating various types of datasets to facilitate their logical integration. Leveraging the data lake architecture, we have achieved semantic-level data governance driven by relational associations and proposed a data management solution for heterogeneous datasets for the unified management of terabyte-scale datasets. In addition, we have conducted the architectural design for the data management system. The prototype system is also developed to offer comprehensive data services, data product production, and other functionalities such as data visualization and analysis. This study provides extensive data services for monitoring and evaluating activities associated with the Sustainable Development Goals (SDGs) of SDG6, SDG11, and SDG15, while also supporting various application demonstrations and effectively facilitating the sustainable development of urban ecosystems.