Acta Scientiarum Naturalium Universitatis Pekinensis

Previous Articles     Next Articles

Designment and Implementation of a Computer Aided Speech Training System for Deaf Children

LIU Huadong, WU Xihong, CHI Huisheng   

  1. National Key Lab. On machine Perception, Peking University, Beijing, 100871; E-mail: {Liuhd, Wxh}@ cis.pku.edu.cn; Chi@pku.edu.cn
  • Received:2003-11-17 Online:2004-05-20 Published:2004-05-20

面向聋儿的计算机言语训练方法及其实现

刘华东, 吴玺宏, 迟惠生   

  1. 北京大学信息科学技术学院智能科学系,视觉与听觉信息处理国家重点实验室,北京,100871;E-mail: {Liuhd, Wxh}@cis.pku.edu.cn; Chi@pku.edu.cn

Abstract: The main work of this paper is to apply speech signal processing and speech recognition technologies in speech training for deaf children, and a computer aided speech training system suited for deaf children is designed and implemented. The system is divided into three modules, basic training, articulation training and intelligibility training, which is in the fashion of visual feedback of speech features. Based on the characteristic of deaf childrens speech training and the relation between acoustical feature and physiological feature, the contrast training method and object training method are proposed. The clinical evaluation was carried out in China Rehabilitation Research Center for Deaf Children and got a good result in second and third grade kindergarten. The experimental results show that it is effective for the contrast training method and object training method to correct the deaf childrens voice disorder and articulation disorder.

Key words: computer aided speech training system, dynamic time warping (DTW), automatic pronouncing evaluation, hidden markov model(HMM)

摘要: 将语音信号处理和语音识别技术应用于聋儿言语训练中,设计并实现了一个适合聋儿使用的言语康复训练系统。根据聋儿言语训练的特点以及语音的声学特征和生理特征的关系,基于语音特征视觉反馈的训练方式,提出了目标训练法和对比训练法。针对聋儿的发音异常和构音异常,设计了从基础训练、构音训练到清晰度训练的计算机言语辅助训练模块。该系统在中国聋儿康复研究中心进行了初步临床实验,在中班和大班聋儿的训练上取得较好效果。实验表明根据目标训练法和对比训练法设计的计算机辅助训练方法能够有效的解决聋儿的发音异常和构音异常。

关键词: 计算机言语辅助训练系统, 动态时间规整, 自动发音评分, 隐马尔可夫模型

CLC Number: