Real-Time Food Simulation Using Real Hand Gesture for Malaysia Cultural Heritage

Virtual Reality (VR) thrives on interactivity, and recent strides in this domain emphasize the role of gesture interaction. This study delves into the immersive realm of hand gestures, designed to liberate VR users from conventional controllers like mice or keyboards. The primary aim is to explore the application of these gestures in preserving and perpetuating the traditional culinary heritage of Pulut Panggang, a revered dish in Malaysian culture. Pulut Panggang, considered intangible heritage, holds cultural significance that transcends generations, particularly among the youth. The study meticulously examines hand gesture movements tailored to emulate the traditional cooking techniques associated with Pulut Panggang. This includes gestures for spatula control, forward and backward motions simulating the rolling of rice, and lateral movements replicating the use of a bamboo fan for grilling the rice rolls. Emphasizing authenticity, the simulation adheres to traditional methodologies, employing customary tools and materials. This approach serves as a poignant means of preserving the essence of traditional cooking methods within the VR environment. By seamlessly integrating hand gesture controls into the simulation, users are guided through the six crucial steps involved in crafting Pulut Panggang.