Automatic Image Caption Generation Based on Some Machine Learning Algorithms

Abstract

This paper is dedicated to machine learning, the branches of machine learning, which include the methods for solving this issue, and the practical implementation of the solution to the automatic image description generation. Automatic image caption generation is one of the frequent goals of computer vision. Image description generation models must solve a larger number of complex problems to have this task successfully solved. The objects in the image must be detected and recognized, after which a logical and syntactically correct textual description is generated. For that reason, description generation is a complex problem. It is an extremely important challenge for machine learning algorithms because it represents an impersonation of a complicated human ability to encapsulate huge amounts of highlighted visual pieces of information in descriptive language. The results of the generated descriptions are compared depending on the used pretrained convolutional networks. The BLEU metrics are used to calculate the quality of the image description. Although the solution to the problem of image description automatic generation does provide us with good results, there is yet room for improvement since there are images that are not adequately described.

A data science and machine learning approach to continuous analysis of Shakespeare's plays

“…In the recent years, machine learning has been used for multiple tasks of text analysis to allow complex analysis of text. These include text generation such as automatic document classification [Kadhim, 2019;Kowsari et al, 2019], text generation [Gatt and Krahmer, 2018;de Rosa and Papa, 2021], text summarization [Gambhir and Gupta, 2017;El-Kassas et al, 2021], sentiment analysis [Zhang et al, 2018;Yadav and Vishwakarma, 2020], automatic caption generation [Bai and An, 2018;Hossain et al, 2019;Predić et al, 2022].…”

Enhancing User Profile Authenticity through Automatic Image Caption Generation Using a Bootstrapping Language–Image Pre-Training Model

“…Next, in the second stage, the Querying Transformer is pre-trained for vision-to-language generative learning, utilizing a frozen Large Language Model (LLM). The authors in [20,21] have presented their work based on CNN and LSTM with integration with ML algorithms. The authors in [22] presented their work of generating the captions for the text summarization technique using an ML-based pre-trained algorithm.…”

“…To achieve pre-training of a unified vision-language model that combines comprehension and generation abilities, the Bootstrapping Language-Image Pre-training (BLIP) model introduces a multimodal encoder-decoder architecture. This architecture serves three key functions [19,20]:…”