With the widespread adoption of generative AI, the field of Natural Language Processing (NLP) is witnessing the emergence of a new era. Historically, NLP has already been shown to have a diverse range of potential use cases within the field of Agile Project Management (APM). Hence, increasing amounts of research are exploring the use of NLP in APM. Through a systematic mapping study, this paper explores the research landscape of applying NLP technologies, including LLMs, to the various activities and practices of APM. It has been found that mostly planning activities have been explored for applying NLP, suggesting that future research may need to explore the use of NLP in other activities of agile project management. Furthermore, research in this field commonly utilizes traditional NLP methods, with notable attention also given to newer LLM technologies, such as generative AI.