Automatic Food Labels Reading System

Growing obesity has been a worldwide issue for several years. This is the outcome of common nutritional disorders which results in obese individuals who are prone to many diseases. Managing diet while simultaneously dealing with the obligations of a working adult can be difficult. Today, people have a very fast-paced life and sometimes neglect food choices. In order to simplify the interpretation of the Nutri-score labeling this paper proposes a method capable of automatically reading food labels with this format. This method is intended to support users when choosing the products to buy based on the letter identification of the label. For this purpose, a dataset was created, and a prototype mobile application was developed using a deep learning network to recognize the Nutri-score information. Although the final solution is still in progress, the reading module, which includes the proposed method, achieved an encouraging and promising accuracy (above 90%). The upcoming developments of the model include information to the user about the nutritional value of the analyzed product combining it’s Nutri-score label and composition.