With the developing of science and technology, railway data is growing explosively. The demand for storage, analysis and sharing of railway big data is improving, which puts forward higher requirements for data services in the railway industry. Currently, railway data is mostly scattered in different information systems and departments, and the data formats and standards are different, which has caused great obstacles to the retrieval, analysis and application of data. A railway data service platform has been developed and successively implemented. The platform has the data service capabilities of massive data collection, storage, governance, analysis and sharing, and can provide basic data, shared data and big data analysis services for business applications such as strategic decision-making, transportation production, operation and development. In order to meet the data analysis and application requirements of complex scenarios of various professions, we developed a lake warehouse architecture to improve the management level of big data.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Centralized Lake Warehouse Architecture for Railway Data Services

  • Yinjun Ma,
  • Jiaqi Wang,
  • Yubin Zhou,
  • Jun Peng

摘要

With the developing of science and technology, railway data is growing explosively. The demand for storage, analysis and sharing of railway big data is improving, which puts forward higher requirements for data services in the railway industry. Currently, railway data is mostly scattered in different information systems and departments, and the data formats and standards are different, which has caused great obstacles to the retrieval, analysis and application of data. A railway data service platform has been developed and successively implemented. The platform has the data service capabilities of massive data collection, storage, governance, analysis and sharing, and can provide basic data, shared data and big data analysis services for business applications such as strategic decision-making, transportation production, operation and development. In order to meet the data analysis and application requirements of complex scenarios of various professions, we developed a lake warehouse architecture to improve the management level of big data.