Given the widespread issues with passwords, Multi-Factor Authentication (MFA) is crucial for protecting online services. Despite vulnerabilities in widely used OTP and app-based MFAs, more secure methods, such as Physical Authentication Devices (PADs), have not garnered widespread adoption. This study aims to understand why the adoption of PADs has lagged behind other forms of MFA. We conducted a two-phase study examining the usability features and subsequent user sentiment towards mainstream PAD devices. In Phase I, participants were sent three commercial PADs to use for two weeks, helping to identify key usability features of these devices. In Phase II, we contextualized these features within commercial PADs and examined user sentiment towards their usability and security features. Our results suggest that different demographic groups preferred different usability and security features, significantly influencing their decision to adopt PADs. Based on the results of our study, we propose methods to enhance the usable security features of PADs, thereby improving their usability and security while assisting with their adoption.