Containerized Data-Flow Processing for Scalable Real-Time Analytics on Edge Devices
摘要
The increasing demand for real-time data analysis in Internet of Things (IoT) ecosystems has created several challenges, particularly in environments where resources are limited, and minimizing data processing latency is critical. This paper investigates the use of Linux Containerization (LXC) as a lightweight, resource-efficient alternative to traditional virtual machine managers for accelerating data-flow processing applications. We propose an architecture that integrates Linux Containerization (LXC) with a Proportional-Integral-Derivative (PID) controller to dynamically manage I/O resource allocation, ensuring Quality of Service (QoS) for I/O-intensive data analytics workloads. The proposed PID controller continuously monitors system performance and dynamically adjusts I/O resource allocation to mitigate performance degradation. Through a series of experiments, we demonstrate that LXC-based solutions outperform traditional methods in managing I/O-intensive data analytics workloads in IoT and edge ecosystems.