High-speed video recordings are crucial for investigating drop dynamics and their interactions with surfaces. Measuring the width of sliding drops, a key parameter linked to frictional forces, requires additional equipment like cameras or mirrors, complicating experimental setups and limiting observable areas. This study introduces a novel method that simplifies the measurement process by employing artificial neural networks to estimate millimeter-scale drop width directly from side-view video data. Our approach processes raw video footage to dynamically identify features most indicative of drop width. By treating drop behavior as an extrinsic time-series problem, our model effectively captures temporal dependencies in video sequences. We propose a VGG8-inspired architecture optimized for small and low information density video datasets. This architecture is combined with our novel position invariant video processing methodology that efficiently removes non-essential regions, reducing computation time by 84%. We further integrate ConvTran, a state-of-the-art time-series classification model, with an enhanced Absolute Position Encoding, improving the encoding’s dot-product and lowering drop width estimation errors. Our novel neural network architecture achieved a root mean square error of 48 \(\upmu \) m (1.7 % relative error), where each pixel corresponds to approximately 44 \(\upmu \) m. Code and data are open-sourced at: https://github.com/shumaly/position_invariant_cnn_transformer .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

CNN-Transformer with Absolute Positional Encoding Optimized for Low-Dimensional Inputs: Applied to Estimate Sliding Drop Width

  • Sajjad Shumaly,
  • Fahimeh Darvish,
  • Mahsa Salehi,
  • Navid Mohammadi Foumani,
  • Oleksandra Kukharenko,
  • Hans-Jürgen Butt,
  • Ulrich Schwanecke,
  • Rüdiger Berger

摘要

High-speed video recordings are crucial for investigating drop dynamics and their interactions with surfaces. Measuring the width of sliding drops, a key parameter linked to frictional forces, requires additional equipment like cameras or mirrors, complicating experimental setups and limiting observable areas. This study introduces a novel method that simplifies the measurement process by employing artificial neural networks to estimate millimeter-scale drop width directly from side-view video data. Our approach processes raw video footage to dynamically identify features most indicative of drop width. By treating drop behavior as an extrinsic time-series problem, our model effectively captures temporal dependencies in video sequences. We propose a VGG8-inspired architecture optimized for small and low information density video datasets. This architecture is combined with our novel position invariant video processing methodology that efficiently removes non-essential regions, reducing computation time by 84%. We further integrate ConvTran, a state-of-the-art time-series classification model, with an enhanced Absolute Position Encoding, improving the encoding’s dot-product and lowering drop width estimation errors. Our novel neural network architecture achieved a root mean square error of 48 \(\upmu \) m (1.7 % relative error), where each pixel corresponds to approximately 44 \(\upmu \) m. Code and data are open-sourced at: https://github.com/shumaly/position_invariant_cnn_transformer .