The most common occurrence of dizziness or vertigo arises when confronted with an abyss, a situation often accompanied by the viscerality of thrill or anxiety. Equally visceral, curiosity, perceived as a gap in our knowledge, can make us susceptible to such abyssal thrill or angst. Paradoxically, curiosity is part of the toolkit that gives momentum to overcoming such anxiety and encourages us to dive into the unknown and explore its depths and knowledge. Yet, the abyss and the anxiety associated with it are more existential, showing connections to oppression, (epistemic) violence, and abyssal thinking. Neither the unknown nor the abyss in themselves yields destructive potential. The processes they unleash and the distinctions they create, however, can become pernicious. This contribution considers the site and sight of the abyss with philosophers such as Édouard Glissant, but also with contemporary thinkers and artists such as the poet Marie-Andrée Gill, in order to contemplate what knowledge can be in the face of the abyss. What do we know when we get dizzy and lose our bearings in the world?