A Novel Image Captioning Approach Using CNN and MLP

Computer vision and natural language processing researchers have dedicated significant time and energy to the problem of automatically creating image descriptions. In this work, we propose an artificially intelligent picture captioner built on a hybrid architecture of convolutional neural networks (CNNs) and multilayer perceptron (MLPs). This system will take photographs as input and generate captions based on those images using algorithms from convolutional neural networks (CNN), multilayer perception (MLP), recurrent neural networks (RNN). To generate a natural language caption, CNN first extracts feature from the input image, and then the MLP analyses these features. The proposed model is trained on a dataset of photos with captions by optimizing the parameters of a convolutional neural network (CNN) and a multilayer perceptron (MLP) via a hybrid of supervised learning and reinforcement learning. Our results demonstrate that the suggested model may produce captions that are on par with the best methods currently available in terms of accuracy and variety. The artificially intelligent picture captioner has potential uses in many areas, such as social networking, e-commerce, and image retrieval systems.