Evaluation of the Scenarios

Each AbstractSwarm scenario developed for the evaluation of the competition provides its own unique logistical challenge. The level of difficulty they pose cannot be determined directly due to the complex mechanisms that influence the difficulty. To get an idea about the level of difficulty of any given evaluation scenario, the data gained about each agent submitted to the competition was regrouped by scenario and plotted. How easily a problem can be solved heavily depends on the implementation of the agents in use. Some algorithmic approaches can perform very well on one problem and then be completely unable to handle another one. The AbstractSwarm competition aims at the development of agents that do well on many different logistical problems. Finally, this chapter briefly reviews the level of difficulty the evaluation scenarios from the 2024 round of the competition provided. Overall, the scenarios from this year provide mixed levels of difficulty, with the scenario SCALEDElevator being the most difficult.