Scholarlink

<p>Digital twins in dairy systems require reliable behavioural inputs. We develop a video-based framework that detects and tracks individual cows and classifies seven behaviours under commercial barn conditions. From 4964 annotated clips, expanded to 9600 through targeted augmentation, we couple YOLOv11 detection with ByteTrack for identity persistence and evaluate SlowFast versus TimeSformer for behaviour recognition. TimeSformer achieved 85.0% overall accuracy (macro-F1 0.84) and real-time throughput of 22.6 fps on NVIDIA L4 hardware. Attention visualizations concentrated on anatomically relevant regions (head and muzzle for feeding and drinking; torso and limbs for postures), supporting biological interpretability. Structured outputs (cow ID, start–end times, durations, and confidence) enable downstream use in nutritional modelling and integration with 3D digital-twin visualization environments, establishing a robust behavioural perception and state-estimation component within a dairy digital-twin architecture. The pipeline delivers continuous, per-animal activity streams suitable for individualized nutrition, predictive health, and automated management, providing a practical foundation for scalable dairy digital twins.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Video-based cattle behaviour detection for digital twin development in precision dairy systems

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月26日

查看全文
  • Shreya Rao,
  • Eduardo Garcia,
  • Suresh Neethirajan

摘要

Digital twins in dairy systems require reliable behavioural inputs. We develop a video-based framework that detects and tracks individual cows and classifies seven behaviours under commercial barn conditions. From 4964 annotated clips, expanded to 9600 through targeted augmentation, we couple YOLOv11 detection with ByteTrack for identity persistence and evaluate SlowFast versus TimeSformer for behaviour recognition. TimeSformer achieved 85.0% overall accuracy (macro-F1 0.84) and real-time throughput of 22.6 fps on NVIDIA L4 hardware. Attention visualizations concentrated on anatomically relevant regions (head and muzzle for feeding and drinking; torso and limbs for postures), supporting biological interpretability. Structured outputs (cow ID, start–end times, durations, and confidence) enable downstream use in nutritional modelling and integration with 3D digital-twin visualization environments, establishing a robust behavioural perception and state-estimation component within a dairy digital-twin architecture. The pipeline delivers continuous, per-animal activity streams suitable for individualized nutrition, predictive health, and automated management, providing a practical foundation for scalable dairy digital twins.