This chapter presents a challenge to the idea that women with disabilities are inherently vulnerable to sexual violence. It provides a critique of the ways in which this belief became and continues to be a dominant narrative in research, policy and practice. Shifting away from this narrative, the chapter presents an Ecological Model of disability violence and abuse (Sobsey 1994), as an alternative model that allows a systemic analysis of disability violence and abuse that aligns with contemporary understandings of gender-based violence. Drawing on narrative co-research with women with disabilities in Australia and New Zealand, it highlights how sexual ableism, deficit ways of thinking about women with disabilities, institutionalisation and sterilisation have framed women with disabilities as sexually vulnerable. This work engaged with people with disabilities to tell their stories of relationships and sexuality and to co-develop how these stories would be shared and used within the prevention of violence. The stories provide an historical and cultural context for understanding the systemic factors impacting on the lives of women with disabilities who have experienced sexual violence.