Artificial Intelligence Empowered Language Models: A Review

Artificial Intelligence (AI) has become increasingly influential in our society due to its ability of mimicking human behavior and intelligence. AI-powered language models are one of the subfields of AI where the type of AI system uses deep learning algorithms to generate and understand natural language. The well-known AI-based language models include RoBERTa by Facebook AI, BERT, T5, ALBERT, and XLNet by Google, ELMo (Embeddings from Language Models) by AI2, GPT-3 by OpenAI, etc. AI-based language models possess the ability to generate novel and unprecedented outputs including realistic images, digital artwork, music, and written content. These outputs often exhibit their style and may even be challenging to differentiate from human-produced creations. The broad scope of AI-based language models has led to its applications in diverse fields such as journalism, customer services, health care, market analysis, etc. This paper presents a comprehensive exploration of research databases, official websites, and documents of prominent technology companies to identify the AI-based language models developed in the past five years from 2018 to 2022. It also highlights their impact and usage on understanding and generation of natural language.