Networked sensors are strategically deployed to gather real-world data, thereby facilitating the implementation of cutting-edge technologies like the IoT and CPS. These devices, tailored to specific use cases, often operate under strict resource constraints and must function optimally for extended periods. Concurrently, the sensitive data they collect must be safeguarded against unauthorized access, necessitating robust security measures. A range of security mechanisms is available to IoT system designers, with cryptographic algorithms, such as symmetric and asymmetric encryption, and hash functions being the cornerstone. They can select from multiple algorithm implementations and adjust configuration parameters to suit the device’s capabilities. However, determining the ideal configuration is a complex task, requiring a balance between security effectiveness and efficient resource utilization. While the security aspect is continually assessed by experts, the impact of these choices on resource consumption, particularly across diverse platforms, often receives less attention. This paper introduces an objective evaluation method that assesses not only the effect of different security algorithms, but also various implementations and configuration adjustments on the resource consumption across different platforms. To facilitate this, a composite performance indicator is computed, enabling the systematic ranking of candidate configurations. The approach bridges the gap in understanding the interplay between security measures and resource management in the realm of IoT devices.