This paper introduces a modern Big Data platform for production and business management, utilizing a hybrid architecture that integrates distributed and cloud-based technologies to enhance processing efficiency. The system employs advanced big data processing technologies, including Hadoop, Spark, Kafka, and AI techniques such as YOLO and CNN, to effectively manage unstructured data. This platform improves system performance, facilitates detailed business queries, and enhances storage and query capabilities. We apply this system to the Vietnam National Coal and Mineral Industry Group (VINACOMIN), resolving inefficiencies in their existing software and achieving a tenfold improvement in speed and report generation efficiency. Experiments show that the system can analyze video data under various conditions using advanced AI techniques, particularly the DeepSearch algorithm. The results demonstrate that the platform optimizes report generation and provides a scalable framework for future Big Data applications in similar industrial settings. This research underscores the transformative potential of innovative Big Data solutions in improving data processing, enabling timely decision-making, and maintaining a competitive advantage in the current business environment.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Design and Implementation of a Big Data Platform for Production and Business Management: A Case Study from Vietnam National Coal and Mineral Industries Group

  • Thi-Thu-Trang Do,
  • Van-Dung Tran,
  • Manh-Hung Ngo,
  • Dinh-Dao Dang,
  • Quang-Thinh Dam,
  • Thai-Bao Mai-Hoang,
  • Van-Quyet Nguyen,
  • Quyet-Thang Huynh

摘要

This paper introduces a modern Big Data platform for production and business management, utilizing a hybrid architecture that integrates distributed and cloud-based technologies to enhance processing efficiency. The system employs advanced big data processing technologies, including Hadoop, Spark, Kafka, and AI techniques such as YOLO and CNN, to effectively manage unstructured data. This platform improves system performance, facilitates detailed business queries, and enhances storage and query capabilities. We apply this system to the Vietnam National Coal and Mineral Industry Group (VINACOMIN), resolving inefficiencies in their existing software and achieving a tenfold improvement in speed and report generation efficiency. Experiments show that the system can analyze video data under various conditions using advanced AI techniques, particularly the DeepSearch algorithm. The results demonstrate that the platform optimizes report generation and provides a scalable framework for future Big Data applications in similar industrial settings. This research underscores the transformative potential of innovative Big Data solutions in improving data processing, enabling timely decision-making, and maintaining a competitive advantage in the current business environment.