Measuring awareness in artificial agents remains an unresolved challenge. We argue that it holds untapped potential for enhancing their design, control, and effectiveness. In this paper, we propose a novel and tractable approach to measure the impact of awareness on system performance, structured around distinct dimensions of awareness – temporal, spatial, metacognitive, self and agentive. Each dimension is linked to specific capacities and tasks. Specifically, we demonstrate our approach through a swarm robotics intralogistics scenario, where we assess the influence of two dimensions of awareness – spatial and self – on the performance of the swarm in a collective transport task. Our results reveal how increased abilities along these awareness dimensions affect overall swarm efficiency. This framework represents an initial step towards quantifying awareness in, and across, artificial systems.