We describe several experiments that were conducted to assess the viability of data pooling as a means to improve speech-recognition performance for under-resourced languages. Two groups of closely related languages from the Southern Bantu language family were studied, and our tests involved phoneme recognition on telephone speech using
standard tied-triphone Hidden Markov Models. Approximately 6 to 11 hours of speech from around 170 speakers was available for training in each language. We find that useful improvements in recognition accuracy can be achieved when pooling data from languages that are highly similar, with two hours of data from a closely related language being approximately equivalent to one hour of data from the target language in the best case. However, the benefit decreases
rapidly as languages become slightly more distant, and is also expected to decrease when larger corpora are available. Our results suggest that similarities in triphone frequencies are the most accurate predictor of the performance of language
pooling in the conditions studied here.
Reference:
Van Heerden, C, Kleynhans, N, Barnard, E and Davel, M. Pooling ASR data for closely related languages. Proceedings of the Workshop on Spoken Languages Technologies for Under-Resourced Languages (SLTU 2010), Penang, Malaysia, May 2010
Van Heerden, C., Kleynhans, N., Barnard, E., & Davel, M. (2010). Pooling ASR data for closely related languages. School of Computer Sciences, Universiti Sains Malaysia. http://hdl.handle.net/10204/5974
Van Heerden, C, N Kleynhans, E Barnard, and M Davel. "Pooling ASR data for closely related languages." (2010): http://hdl.handle.net/10204/5974
Van Heerden C, Kleynhans N, Barnard E, Davel M, Pooling ASR data for closely related languages; School of Computer Sciences, Universiti Sains Malaysia; 2010. http://hdl.handle.net/10204/5974 .