Educating Manufacturing Operators by Extending Reality with AI

Emerging user interface technologies such as Augmented RealityAugmented Reality (AR) and and Virtual RealityVirtual Reality (VR), falling under the umbrella term Extended RealityExtended Reality (XR), may leverage Artificial IntelligenceArtificial Intelligence (AI) to allow the creation of virtual learning spaces enabling unique pedagogical tools and educational experiences. In this Chapter, we present three approaches utilising AR and VR environments to illustrate the potential of integrating these emerging technologies with AI for manufacturing educationManufacturing Education. We first demonstrate how an AR interface facilitated with a see-through head-mounted display enhanced with computer visionComputer Vision capabilities enables assisted contextual learning using in-situ guidance by projecting immediate support for novice operators performing common maintenance and repair tasks on 3D printers. We then demonstrate how VR and Head-Mounted Display Virtual RealityVirtual Reality (HMDVR)—with different levels of immersion—enable ex-situ learning spaces to enable remote learning of assembly tasks. Together, the AR, Desktop-based Virtual RealityVirtual Reality (DVR), and HMDVR examples demonstrate the potential of rethinking the design of pedagogic learning spaces using XR technology. We complement our results with a discussion on the future trajectory of AI-based education.