Understanding molecular structures in three dimensions is essential for learning key chemistry concepts such as geometry, stereochemistry, and atomic interactions. However, traditional tools often rely on static two-dimensional representations that limit spatial reasoning. This work presents an immersive system that integrates smartwatches, machine learning, and mobile virtual reality through Google Cardboard. Users draw atomic symbols on a smartwatch, which are recognized by a cloud-based neural network and rendered as 3D molecular models in real time. By combining gesture-based input, cloud processing, and immersive visualization on a smartphone using Google Cardboard, the system seeks to provide an intuitive and accessible learning experience grounded in enactive cognition. Preliminary results demonstrate its usability, engagement potential, and suitability in educational contexts.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Low-Cost Immersive Molecule Visualization from Hand-Drawn Smartwatch Input for Virtual Reality Learning

  • Jamilly Santos,
  • Marcos Vieira,
  • Deborah Fernandes,
  • Juliana Félix,
  • Welington Rodrigues,
  • Fabrizzio Soares,
  • Thamer Horbylon Nascimento

摘要

Understanding molecular structures in three dimensions is essential for learning key chemistry concepts such as geometry, stereochemistry, and atomic interactions. However, traditional tools often rely on static two-dimensional representations that limit spatial reasoning. This work presents an immersive system that integrates smartwatches, machine learning, and mobile virtual reality through Google Cardboard. Users draw atomic symbols on a smartwatch, which are recognized by a cloud-based neural network and rendered as 3D molecular models in real time. By combining gesture-based input, cloud processing, and immersive visualization on a smartphone using Google Cardboard, the system seeks to provide an intuitive and accessible learning experience grounded in enactive cognition. Preliminary results demonstrate its usability, engagement potential, and suitability in educational contexts.