Augmented Imagination: Creating Immersive and Playful Reading Experiences

In this chapter, we investigate physical and digital approaches to the phenomenon of book augmentation. Physical approaches do not embed any electronic elements into the book. On the contrary, in digital approaches interactivity is supported by embedding electronic devices into the physical book, holding devices above the book or by placing electronic devices around the reader. Firstly, we describe and analyse ten augmented books that use different augmentation techniques (along the following three dimensions: the modalities being used, the type of content on offer and the impact of the augmentation on the reading flow). We then emphasise the need for further investigation of the ways for delivering multimodal and immersive content, in which the processes of reading the original text, interacting and consuming the digital content merge into one unified experience that does not disrupt the reading flow and enhances the sense of immersion in the story. Finally, we illustrate how we could move towards this vision of a unified augmented reading experience using different technologies, such as speech recognition systems, eye- and head-tracking systems, generative AI, olfactory displays, smell synthesisers and digitally controlled food delivery systems.