On Learning Vocal Tract System Related Speaker Discriminative Information from Raw Signal Using CNNs

Hannah Muckenhirn, Mathew Magimai.-Doss and Sebastien Marcel

Abstract:

In a recent work, we have shown that speaker verification systems can be built where both features and classifiers are directly learned from the raw speech signal with convolutional neural networks (CNNs). In this framework, the training phase also decides the block processing through cross validation. It was found that the first convolution layer, which processes about 20 ms speech, learns to model fundamental frequency information. In the present paper, inspired from speech recognition studies, we build further on that framework to design a CNN-based system, which models sub-segmental speech (about 2ms speech) in the first convolution layer, with an hypothesis that such a system should learn vocal tract system related speaker discriminative information. Through experimental studies on Voxforge corpus and analysis on American vowel dataset, we show that the proposed system (a) indeed focuses on formant regions, (b) yields competitive speaker verification system and (c) is complementary to the CNN-based system that models fundamental frequency information.

---

Cite as: Muckenhirn, H., Magimai.-Doss, M., Marcel, S. (2018) On Learning Vocal Tract System Related Speaker Discriminative Information from Raw Signal Using CNNs. Proc. Interspeech 2018, 1116-1120, DOI: 10.21437/Interspeech.2018-1696.

---

BiBTeX Entry:

@inproceedings{Muckenhirn2018,
author={Hannah Muckenhirn and Mathew Magimai.-Doss and Sebastien Marcel},
title={On Learning Vocal Tract System Related Speaker Discriminative Information from Raw Signal Using CNNs},
year=2018,
booktitle={Proc. Interspeech 2018},
pages={1116--1120},
doi={10.21437/Interspeech.2018-1696},
url={http://dx.doi.org/10.21437/Interspeech.2018-1696} }