Augmenting Reality with Shitsukan
摘要
This chapter explores the capabilities and challenges of in situ Shitsukan (material appearance) manipulation through augmented reality (AR) technologies, focusing on two main approaches: projection mapping (PM) and optical see-through AR (OST-AR) systems. Digital Shitsukan manipulation allows for modifying the perceived material properties of physical surfaces, and AR enables these modifications to be experienced in real-world scenarios. We discuss various applications, including makeup simulation, product design, and tactile feedback, as well as the technical challenges of geometric alignment, radiometric compensation, and visual consistency in AR-based Shitsukan manipulation. Additionally, we address emerging hybrid systems, such as beaming displays, that combine PM and OST-AR technologies for enhanced experiences. Finally, we outline future research directions, highlighting the potential of AR-based Shitsukan manipulation in various fields.