Designing prosody rule-set for converting neutral TTS speech to storytelling style speech for Indian languages: Bengali, Hindi and Telugu

This paper provides a design of prosody rule-set for transforming the neutral speech synthesized by Text-to-Speech (TTS) system to storytelling style speech. The objective of this work is to synthesize storyteller speech from the neutral TTS system for a given story text as input. In this work, neut...

Full description

Saved in:

Bibliographic Details
Published in:	2014 Seventh International Conference on Contemporary Computing (IC3) pp. 473 - 477
Main Authors:	Sarkar, Parakrant, Haque, Arijul, Dutta, Arup Kumar, Reddy, Gurunath M., Harikrishna, M. D., Dhara, Prasenjit, Verma, Rashmi, Narendra, P. N., Sunil, B. Kr S., Yadav, Jainath, Rao, K. Sreenivasa
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01-08-2014
Subjects:	Emotion recognition emotion-salient words Expressive speech synthesis Information technology Neutral TTS Prosody rule-set Semantics Speech Speech recognition Speech synthesis Story specific prosody generation story-specific emotion detection story-specific prosody incorporation Storytelling style
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	This paper provides a design of prosody rule-set for transforming the neutral speech synthesized by Text-to-Speech (TTS) system to storytelling style speech. The objective of this work is to synthesize storyteller speech from the neutral TTS system for a given story text as input. In this work, neutral TTS refers to TTS system developed using Festival framework with neutral speech corpus. For generating storyteller speech from neutral TTS, we are proposing modifications to various prosodic parameters of neutral synthesized speech. In this work, the prosodic parameters considered for modification are (i) pitch contour, (ii) duration patterns, (iii) intensity patterns, (iv) pause patterns and (v) tempo. We have designed individual rule-sets for the above mentioned prosodic parameters, separately for three Indian languages Bengali, Hindi and Telugu. The rule-sets are designed carefully by analyzing the perceptual differences between synthesized neutral speech utterances and their respective natural (original) spoken utterances, narrated by a storyteller. The designed prosody rule-sets are evaluated using subjective listening tests. The results of the perceptual evaluation indicate that the designed prosody rule-sets play a significant role in achieving the story-specific style during conversion from neutral to storytelling style speech.
ISBN:	1479951722 9781479951727
DOI:	10.1109/IC3.2014.6897219