Robotic-Assisted Adaptive 3D Digital Image Correlation with Visual Servoing-Based Tracking
摘要
With advancing research in flexible robotics, human biomechanics and material failure mechanisms, higher requirements are imposed on measurement system adaptability. Traditional three-dimensional digital image correlation (3D-DIC) method employs fixed measurement position, limiting measurement range and position without adaptive adjustment capability.
ObjectiveThis study aims to develop an adaptive 3D-DIC method capable of continuously tracking and measuring deformation of targets undergoing large-range both in-plane and out-of-plane motion, and pose variations.
MethodsThe 3D-DIC system is affixed to the end effector of a robotic arm, which facilitates camera movement. This method achieves real-time tracking and observation of speckle targets through YOLOv11-based detection combined with position-based visual servoing. It also performs accurate deformation measurements by mapping the reconstructed 3D coordinates to a fixed world coordinate system to eliminate the effects of camera motion.
ResultsThe proposed system achieved sub-millimeter displacement accuracy, with maximum errors of 0.0558 mm over 190 mm in-plane motion and 0.0699 mm over 165 mm out-of-plane motion. Compared with fixed 3D-DIC, it produced more stable and accurate principal strain fields across large-range motions. Continuous observation was further validated under pose variations (20 poses, up to 105.2°). In finger–glass contact sliding experiments (197 mm lateral and 136 mm longitudinal), the method captured strain-field evolution from onset to steady sliding and localized stick–slip instants via velocity-spike detection.
ConclusionsThe proposed robotic-assisted adaptive 3D-DIC method effectively addresses measurement challenges under complex motion conditions. This method effectively facilitates finger-glass contact measurements, providing more authentic experimental data for contact mechanics and haptics.