This paper presents a comprehensive tongue diagnosis system that integrates Traditional Chinese Medicine (TCM) constitution theory with advanced deep learning techniques. Tongue diagnosis, a vital component of TCM's “inspection” method, has long relied on practitioners’ subjective experience, leading to inconsistent diagnostic standards and susceptibility to external factors. To address these challenges, we propose a system combining YOLOv11 for detection, U2-Net for segmentation, and ResNet50 for classification of tongue images. Our system leverages the strengths of these models to overcome limitations in traditional tongue diagnosis, offering an efficient and accurate solution. We constructed a standardized dataset of 3,000 tongue images across nine constitutional types, collected under varied lighting conditions to ensure robustness. The experimental results demonstrate the system's effectiveness in automatically detecting, segmenting, and classifying tongue images, with significant improvements in diagnostic accuracy and efficiency. This study paves the way for the objectification and standardization of TCM inspection, providing a promising tool for mobile-based TCM diagnostic assistance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Integrating TCM Constitution Theory with Deep Learning for Tongue Image Analysis

  • Zixuan Chen,
  • Jin Wang,
  • Yuzhen Liu,
  • Xiaolan Zhou,
  • Xiaoliang Wang

摘要

This paper presents a comprehensive tongue diagnosis system that integrates Traditional Chinese Medicine (TCM) constitution theory with advanced deep learning techniques. Tongue diagnosis, a vital component of TCM's “inspection” method, has long relied on practitioners’ subjective experience, leading to inconsistent diagnostic standards and susceptibility to external factors. To address these challenges, we propose a system combining YOLOv11 for detection, U2-Net for segmentation, and ResNet50 for classification of tongue images. Our system leverages the strengths of these models to overcome limitations in traditional tongue diagnosis, offering an efficient and accurate solution. We constructed a standardized dataset of 3,000 tongue images across nine constitutional types, collected under varied lighting conditions to ensure robustness. The experimental results demonstrate the system's effectiveness in automatically detecting, segmenting, and classifying tongue images, with significant improvements in diagnostic accuracy and efficiency. This study paves the way for the objectification and standardization of TCM inspection, providing a promising tool for mobile-based TCM diagnostic assistance.