Homophone Identification and Merging for Code-switched Speech Recognition

Brij Mohan Lal Srivastava and Sunayana Sitaram

Abstract:

Code-switching or mixing is the use of multiple languages in a single utterance or conversation. Borrowing occurs when a word from a foreign language becomes part of the vocabulary of a language. In multilingual societies, switching/mixing and borrowing are not always clearly distinguishable. Due to this, transcription of code-switched and borrowed words is often not standardized and leads to the presence of homophones in the training data. In this work, we automatically identify and disambiguate homophones in code-switched data to improve recognition of code-switched speech. We use a WX-based common pronunciation scheme for both languages being mixed and unify the homophones during training, which results in a lower word error rate for systems built using this data. We also extend this framework to propose a metric for code-switched speech recognition that takes into account homophones in both languages while calculating WER, which can help provide a more accurate picture of errors the ASR system makes on code-switched speech.

---

Cite as: Srivastava, B.M.L., Sitaram, S. (2018) Homophone Identification and Merging for Code-switched Speech Recognition. Proc. Interspeech 2018, 1943-1947, DOI: 10.21437/Interspeech.2018-1171.

---

BiBTeX Entry:

@inproceedings{Srivastava2018,
author={Brij Mohan Lal Srivastava and Sunayana Sitaram},
title={Homophone Identification and Merging for Code-switched Speech Recognition},
year=2018,
booktitle={Proc. Interspeech 2018},
pages={1943--1947},
doi={10.21437/Interspeech.2018-1171},
url={http://dx.doi.org/10.21437/Interspeech.2018-1171} }