The concept of Digital Twins has revolutionized the way physical systems are monitored, controlled, and optimized. This technology has seen rapid adoption across industries such as manufacturing [127], healthcare [2], and aerospace [191], where it enables better decision-making, predictive maintenance, and overall system performance improvements. Additionally, these digital replicas can be the perfect environments for training RL agents due to the possibility of simulating different policies without risk.