Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models

Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and cross-lingual detoxification and the behavior of large mult...

Full description

Saved in:
Bibliographic Details
Main Authors: Moskovskiy, Daniil, Dementieva, Daryna, Panchenko, Alexander
Format: Journal Article
Language:English
Published: 05-06-2022
Subjects:
Computer Science - Computation and Language
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and cross-lingual detoxification and the behavior of large multilingual models like in this setting. Unlike previous works we aim to make large language models able to perform detoxification without direct fine-tuning in given language. Experiments show that multilingual models are capable of performing multilingual style transfer. However, models are not able to perform cross-lingual detoxification and direct fine-tuning on exact language is inevitable.
DOI:10.48550/arxiv.2206.02252