Challenges and Future Considerations
摘要
This chapter discusses some of the key challenges, such as convergence, complexity, overhead, state-action space dimension, exploration, and stability concerns, in implementing DRL for Age of Information (AoI)-aware UAV-IoT applications. It also examines issues in performing simulation models as opposed to the real-world deployments of such applications. Some of the discussed simulation-based challenges include reliability of network connections, traffic generation pattern adaptation, security threats, UAV assumptions, environmental challenges, and parameters, as well as hyperparameter selection. A visual map of these challenges is summarised in Fig. 4.1.