Purpose <p>In recent years, computer-aided diagnosis (CAD) using deep learning methods for medical images has been studied. Although studies have been conducted to classify ultrasound images of tumors of the liver into four categories (liver cysts (Cyst), liver hemangiomas (Hemangioma), hepatocellular carcinoma (HCC), and metastatic liver cancer (Meta)), no studies with additional information for deep learning have been reported. Therefore, we attempted to improve the classification accuracy of ultrasound images of hepatic tumors by adding hepatitis virus infection information to deep learning.</p> Methods <p>Four combinations of hepatitis virus infection information were assigned to each image, plus or minus HBs antigen and plus or minus HCV antibody, and the classification accuracy was compared before and after the information was input and weighted to fully connected layers.</p> Results <p>With the addition of hepatitis virus infection information, accuracy changed from 0.574 to 0.643. The F1-Score for Cyst, Hemangioma, HCC, and Meta changed from 0.87 to 0.88, 0.55 to 0.57, 0.46 to 0.59, and 0.54 to 0.62, respectively, remaining the same for Hemangioma but increasing for the rest.</p> Conclusion <p>Learning hepatitis virus infection information showed the highest increase in the F1-Score for HCC, resulting in improved classification accuracy of ultrasound images of hepatic tumors.</p>