Cultural heritage comprises not merely visual but multisensory experiences that individuals and communities share and which are related to specific sites and locations. Olfactory memories in particular are tightly connected to people, places and the physical 3D space and they are deeply ingrained in our emotion; they have a profound ability to connect people and communities through deeply shared experiences. The emerging field of Olfactory Cultural Heritage focuses on ways to capture, present and share olfactory experiences that are of value to a community. In this chapter, we suggest that digital maps can be employed to this end, functioning as a highly interactive medium. This requires that one goes beyond state of the art use of maps for documenting, delimiting and connecting heritage sites to their physical contexts, to employing maps as a communication tool; we identify the interdisciplinary challenges involved in large-scale collection, cartographic representation and visualisation of olfactory memories and propose research directions that require joint efforts from a number of disciplines including Cartography, Language Science and Engineering, and Cognitive Science.