An intelligent scheduling and resource prediction framework using multidimensional data streams and deep reinforcement learning
摘要
In cloud computing environments, the dynamic and unpredictable nature of user demands and workloads poses significant challenges to resource scheduling and management. To address these challenges, we propose MDRP (multidimensional data stream based Resource Prediction and intelligent scheduling), a novel framework that integrates real-time multidimensional data stream analysis with intelligent scheduling and proactive resource prediction. MDRP captures diverse system-level and application-level metrics–including CPU, memory, I/O, network usage, task characteristics, and historical behavior–to build a holistic representation of system states. A deep reinforcement learning(RL) module is designed to dynamically adjust scheduling decisions based on predicted workload patterns and resource utilization trends. Moreover, the framework incorporates time series forecasting to anticipate future resource demands, enabling proactive scaling and migration strategies. Experimental results on simulated cloud environments demonstrate that MDRP improves task completion efficiency by 8.1%, reduces resource contention by 12.3%, and enhances system stability by 9.4% compared to existing methods.