This chapter explores the connections between space and memory using the literary landscapes of New York to construct a “mnemonic empathy” for contemporary readers. Through reading, moving and remembering, we can observe the sites of poverty, inequality and alienation in the metropolis not as places of drama in the lives of others, but as locations where our moral vision is exercised. What we remember in these accounts calls us to account. Through examining the travel literature of the nineteenth century, which portrayed the city as a den of iniquity, to the novels of the twentieth century, which depict journeys across the metropolis and its structures of class, gender and ethnicity, we can observe a city of memory. In this act of remembrance, we create a new mnemonic landscape, connecting up places and people in order for us to act as witnesses.