计算机工程与应用
計算機工程與應用
계산궤공정여응용
COMPUTER ENGINEERING AND APPLICATIONS
2015年
3期
202-207
,共6页
语音口型匹配%汉语语音%口型视位
語音口型匹配%漢語語音%口型視位
어음구형필배%한어어음%구형시위
matching between speech and mouth shape%Chinese speech%mouth viseme
构建一种基于文本和朗读语音共同驱动的双模态语音与口型匹配控制模型,充分利用文本拼音提供正确的口型视位,利用朗读语音为口型视位提供正确的时序,在此基础上对口型几何参数和时间参数进行离散化,根据汉语语音发音机理,合理控制语音的口型动作过程。
構建一種基于文本和朗讀語音共同驅動的雙模態語音與口型匹配控製模型,充分利用文本拼音提供正確的口型視位,利用朗讀語音為口型視位提供正確的時序,在此基礎上對口型幾何參數和時間參數進行離散化,根據漢語語音髮音機理,閤理控製語音的口型動作過程。
구건일충기우문본화랑독어음공동구동적쌍모태어음여구형필배공제모형,충분이용문본병음제공정학적구형시위,이용랑독어음위구형시위제공정학적시서,재차기출상대구형궤하삼수화시간삼수진행리산화,근거한어어음발음궤리,합리공제어음적구형동작과정。
A bimodal-drive matching scheme between Chinese speech and mouth shape is proposed, which is jointly driven by text and read speech. During the disposal of matching, the accurate mouth viseme is calculated with the spelling of text, and the correct time sequence of mouth viseme is given by read speech. Thereafter, the geometrical parameter and the time parameter of mouth motion are discretized. Then, according to the pronunciation mechanism of Chinese speech, the mouth motion of speech is controlled suitably and correctly.