A Tongue Image Classification Method in TCM Based on Multi Feature Fusion

Traditional Chinese medicine distinguishes tongue features such as tongue color, fur color, tongue shape and crack mainly through the visual observation and empirical analysis of traditional Chinese medicine doctors. Therefore, the judgment standard will be affected by the subjective factors of doctors and surrounding environment. These factors restrict the application and development of tongue diagnosis. Therefore, objectifying tongue diagnosis information and standardizing diagnosis is an important direction of tongue diagnosis automation research. This paper presents a classification method of TCM tongue image based on multi feature fusion. By constructing a multi feature fusion model, two sub networks are used to classify the different features of the tongue image, so as to realize the task of multi feature classification of the tongue image. The model classifies the tongue image into tongue color classification, fur color classification, tongue shape classification and crack classification, and outputs the color parameters of tongue color and fur color while outputting the classification results. The model adds the method of transfer learning, which can reduce the demand for the amount of tongue image data, At the same time, the accuracy of the model is improved.