<p>Amidst stereotypes and constructions of gender, masculine sexuality has been described as agentic in comparison to a passive female sexuality, requiring acts of manhood to maintain its privileged position vis-à-vis women. Because of the attached privileges and the way they maintain the status quo in a gendered hierarchy, men use these norms to evaluate themselves and condemn themselves and others when they do not meet expectations. When applied to men’s sexuality, upholding norms of manhood may interfere with men’s ability to withdraw consent during sex. It may additionally have an impact on their conceptualization around whether they consented or wanted to consent at all. Using a thematic/discourse analysis in interviews with 18 men around the question of “troubling sex” we focus closely on 5 interviews that describe moments of ambivalent sex and ambiguous consent. We use the conceptual framework of “voices of the mind” to examine the discourses that require men to do something with the ambiguous consent or ambivalent sexual experience that recalibrate their ideas of themselves as men. We make comparisons with how women explain unwanted but consented to sex.</p>