Data lakes are a storage system for large volumes of raw heterogeneous data, adopting an area-based architecture. The main challenge of this architecture is the extraction and storage of raw data without any content monitoring, making data processing and access difficult. In this paper, we propose the integration of an ontology into this architecture, particularly in the data extraction and access areas. In the data extraction area, the role of the ontology is to eliminate ambiguities and terminological confusion to ensure reliable data extraction. In the data access area, the ontology will transform simple queries into semantic data access queries. This architecture improves the data preparation and data access stages, which are essential for leveraging stored data.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Towards a Semantic Architecture for Data Lakes

  • Aboubacar Sione,
  • Yaya Traore,
  • Julie Thiombiano

摘要

Data lakes are a storage system for large volumes of raw heterogeneous data, adopting an area-based architecture. The main challenge of this architecture is the extraction and storage of raw data without any content monitoring, making data processing and access difficult. In this paper, we propose the integration of an ontology into this architecture, particularly in the data extraction and access areas. In the data extraction area, the role of the ontology is to eliminate ambiguities and terminological confusion to ensure reliable data extraction. In the data access area, the ontology will transform simple queries into semantic data access queries. This architecture improves the data preparation and data access stages, which are essential for leveraging stored data.