The Recent Large Language Models in NLP

The Recent Large Language Models in NLP

Over the past few years, Natural Language Processing (NLP) has evolved significantly thanks to the development of large Language Models (LMs). In this paper, we present a survey of four recent language models that we believe have had a significant importance in the NLP field lately: BERT (Google), E...

Full description

Saved in:
Bibliographic Details
Published in:2023 22nd International Symposium on Communications and Information Technologies (ISCIT) pp. 1 - 6
Main Authors: Le, Ngoc Tran Khanh, Hadiprodjo, Nadia, El-Alfy, Hazem, Kerimzhanov, Aziz, Teshebaev, Avtandil
Format: Conference Proceeding
Language:English
Published: IEEE 16-10-2023
Subjects:
application
architecture
BERT
Chatbots
data
ELMo
GPT-3
Information and communication technology
Internet
LLaMA
LLM(s)
NLP
Performance evaluation
pre-trained
state-of-art
Surveys
Training data
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Over the past few years, Natural Language Processing (NLP) has evolved significantly thanks to the development of large Language Models (LMs). In this paper, we present a survey of four recent language models that we believe have had a significant importance in the NLP field lately: BERT (Google), ELMo (Allen Institute), GPT-3 (OpenAI), and LLaMA (Meta AI). For each model, we analyse its architecture, the dataset on which it was trained, its performance evaluation, as well as the strengths and challenges faced by each. Our paper compares the recent Language Models and their contributions to the field of NLP, and discusses future extensions.
ISSN:2643-6175
DOI:10.1109/ISCIT57293.2023.10376050