Ramli, Izzad and Jamil, Nursuriati and Seman, Noraini (2021) An Iterated Two-Step Sinusoidal Pitch Contour Formulation for Expressive Speech Synthesis. Journal of Information and Communication Technology, 20 (04). pp. 489-510. ISSN 2180-3862

PDF - Published Version Restricted to Registered users only Download (756kB) | Request a copy

Abstract

Intonation generation in expressive speech such as storytelling is essential to produce high quality Malay language expressive speech synthesizer. Intonation generation, for instance explicit control, has shown good performance in terms of intelligibility with reasonably natural speech; thus, it was selected in this research. This approach modifies the prosodic features, such as pitch contour, intensity, and duration, to generate the intonation. However, modification of pitch contour remains a problem because the desired pitch contour is not achieved. This paper formulated an improved pitch contour algorithm to develop a modified pitch contour resembling the natural pitch contour. In this work, the syllable pitch contours of nine storytellers were extracted from their storytelling speeches to create an expressive speech syllable dataset called STORY_DATA. All the shapes of pitch contours from STORY_DATA were analyzed and clustered into the standard six main pitch contour clusters for storytelling. The clustering was performed using one minus the Pearson product moment correlation. Then, an improved iterative two-step sinusoidal pitch contour formulation was introduced to modify the pitch contours of a neutral speech into an expressive pitch contour of natural speeches. Overall, the improved pitch contour formulation was able to achieve 93 percent high correlated matches, indicating the high resemblance as compared to the previous pitch contour formulation at 15 percent. Therefore, the improved formula can be used in a text-to-speech (TTS) synthesizer to produce a more natural expressive speech. The paper also discovered unique expressive pitch contours in the Malay language that need further investigations in the future.

Item Type:	Article
Uncontrolled Keywords:	Pitch contour formulation, prosody modification, speech synthesis, storytelling
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	College of Arts and Sciences
Depositing User:	Mrs Nurin Jazlina Hamid
Date Deposited:	27 Jul 2022 01:59
Last Modified:	27 Jul 2022 02:04
URI:	https://repo.uum.edu.my/id/eprint/28759

Actions (login required)

View Item