Scholarlink

<p>Accurate measurement of key phenotypic traits, including the horizontal and vertical diameters, the weights of both fruit and pit, is essential for the selection of elite litchi cultivars and the advancement of breeding research. Manual measurement, however, is laborious, inefficient, and subjective, highlighting the urgent need for automated and precise phenotyping tools. Unlike apples, mangoes, and grapes, litchi combines a spiny, highly variable pericarp (heterogeneous areoles/tubercles across cultivars) with diverse seed morphology (including irregular, wrinkled aborted seeds), thereby increasing the difficulty of semantic segmentation and biasing diameters and weight estimation. This study presents LitchiPhenoNet, a multimodal learning framework for litchi phenotypic analysis that employs a dual-branch architecture integrating RGB (color/texture) and depth (spatial/structural) information. Experiments were conducted on an RGB–D dataset comprising 1,198 image pairs (1280<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\times \)</EquationSource> </InlineEquation>720) across 10 cultivars, using a stratified train/test split of 958/240 pairs by cultivar. To address inherent semantic and scale inconsistencies between modalities, the framework incorporates the RD-Fusion module for precise cross-modal feature extraction, improving robustness under complex and variable pericarp surfaces. Comparative experiments show that LitchiPhenoNet consistently outperforms leading YOLO-based models, achieving millimeter-level diameter estimation with coefficients of determination approaching 0.98 and mean errors within 2&#xa0;mm. For weight estimation, gram-level precision is attained across whole fruit, pit, and pulp, with coefficients of determination up to 0.98 and mean errors comparable to repeated manual measurements. By handling fine-scale surface relief and cross-cultivar variability, the framework is readily extensible to other textured fruits and scalable for high-throughput phenotyping in breeding programs. Collectively, these results demonstrate that LitchiPhenoNet provides an efficient, reliable, and accurate solution for quantifying litchi phenotypic traits, substantially advancing the objectivity and efficiency of phenotypic analysis and breeding selection.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Multimodal learning on RGB-D image for precise litchi phenotyping and weight estimation

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月4日

查看全文
  • Mingchao Yang,
  • Riyao Chen,
  • Ding Chen,
  • Huicong Wang,
  • Xianghe Wang,
  • Fuchu Hu

摘要

Accurate measurement of key phenotypic traits, including the horizontal and vertical diameters, the weights of both fruit and pit, is essential for the selection of elite litchi cultivars and the advancement of breeding research. Manual measurement, however, is laborious, inefficient, and subjective, highlighting the urgent need for automated and precise phenotyping tools. Unlike apples, mangoes, and grapes, litchi combines a spiny, highly variable pericarp (heterogeneous areoles/tubercles across cultivars) with diverse seed morphology (including irregular, wrinkled aborted seeds), thereby increasing the difficulty of semantic segmentation and biasing diameters and weight estimation. This study presents LitchiPhenoNet, a multimodal learning framework for litchi phenotypic analysis that employs a dual-branch architecture integrating RGB (color/texture) and depth (spatial/structural) information. Experiments were conducted on an RGB–D dataset comprising 1,198 image pairs (1280 \(\times \) 720) across 10 cultivars, using a stratified train/test split of 958/240 pairs by cultivar. To address inherent semantic and scale inconsistencies between modalities, the framework incorporates the RD-Fusion module for precise cross-modal feature extraction, improving robustness under complex and variable pericarp surfaces. Comparative experiments show that LitchiPhenoNet consistently outperforms leading YOLO-based models, achieving millimeter-level diameter estimation with coefficients of determination approaching 0.98 and mean errors within 2 mm. For weight estimation, gram-level precision is attained across whole fruit, pit, and pulp, with coefficients of determination up to 0.98 and mean errors comparable to repeated manual measurements. By handling fine-scale surface relief and cross-cultivar variability, the framework is readily extensible to other textured fruits and scalable for high-throughput phenotyping in breeding programs. Collectively, these results demonstrate that LitchiPhenoNet provides an efficient, reliable, and accurate solution for quantifying litchi phenotypic traits, substantially advancing the objectivity and efficiency of phenotypic analysis and breeding selection.