The increasing demand for real-time data analysis in Internet of Things (IoT) ecosystems has created several challenges, particularly in environments where resources are limited, and minimizing data processing latency is critical. This paper investigates the use of Linux Containerization (LXC) as a lightweight, resource-efficient alternative to traditional virtual machine managers for accelerating data-flow processing applications. We propose an architecture that integrates Linux Containerization (LXC) with a Proportional-Integral-Derivative (PID) controller to dynamically manage I/O resource allocation, ensuring Quality of Service (QoS) for I/O-intensive data analytics workloads. The proposed PID controller continuously monitors system performance and dynamically adjusts I/O resource allocation to mitigate performance degradation. Through a series of experiments, we demonstrate that LXC-based solutions outperform traditional methods in managing I/O-intensive data analytics workloads in IoT and edge ecosystems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Containerized Data-Flow Processing for Scalable Real-Time Analytics on Edge Devices

  • MohammadReza HoseinyFarahabady,
  • Albert Y. Zomaya

摘要

The increasing demand for real-time data analysis in Internet of Things (IoT) ecosystems has created several challenges, particularly in environments where resources are limited, and minimizing data processing latency is critical. This paper investigates the use of Linux Containerization (LXC) as a lightweight, resource-efficient alternative to traditional virtual machine managers for accelerating data-flow processing applications. We propose an architecture that integrates Linux Containerization (LXC) with a Proportional-Integral-Derivative (PID) controller to dynamically manage I/O resource allocation, ensuring Quality of Service (QoS) for I/O-intensive data analytics workloads. The proposed PID controller continuously monitors system performance and dynamically adjusts I/O resource allocation to mitigate performance degradation. Through a series of experiments, we demonstrate that LXC-based solutions outperform traditional methods in managing I/O-intensive data analytics workloads in IoT and edge ecosystems.