Itihasa: A large-scale corpus for Sanskrit to English translation

Itihasa: A large-scale corpus for Sanskrit to English translation

This work introduces Itihasa, a large-scale translation dataset containing 93,000 pairs of Sanskrit shlokas and their English translations. The shlokas are extracted from two Indian epics viz., The Ramayana and The Mahabharata. We first describe the motivation behind the curation of such a dataset a...

Full description

Saved in:
Bibliographic Details
Main Authors: Aralikatte, Rahul, de Lhoneux, Miryam, Kunchukuttan, Anoop, Søgaard, Anders
Format: Journal Article
Language:English
Published: 06-06-2021
Subjects:
Computer Science - Computation and Language
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This work introduces Itihasa, a large-scale translation dataset containing 93,000 pairs of Sanskrit shlokas and their English translations. The shlokas are extracted from two Indian epics viz., The Ramayana and The Mahabharata. We first describe the motivation behind the curation of such a dataset and follow up with empirical analysis to bring out its nuances. We then benchmark the performance of standard translation models on this corpus and show that even state-of-the-art transformer architectures perform poorly, emphasizing the complexity of the dataset.
DOI:10.48550/arxiv.2106.03269