HFCAS OpenIR  > 中科院合肥智能机械研究所
A realistic 3D articulatory animation system for emotional visual pronunciation
Yu, Lingyun1; Yu, Jun1; Wang, Zengfu1,2
2017-09-01
发表期刊MULTIMEDIA TOOLS AND APPLICATIONS
卷号76期号:18页码:19241-19262
摘要This paper proposes a realistic 3D articulatory animation system for emotional visual pronunciation driven by the emotional articulatory movement trajectory. Firstly, the articulatory movements, recorded by Electro-Magnetic Articulatory (EMA), are trained by Hidden Markov Model (HMM) while the fully context-dependent model is taken into account by making full use of the rich linguistic features. Secondly, owing to the independency in the manipulation of articulators, the articulatory movements are more remarkably adjusted to express different emotions. Thirdly, the emotional speech is generated by adjusting the neutral speech parameters, such as fundamental frequency (F0), duration and intensity, based on Praat. Then the corresponding articulatory movements are synthesized by the HMM prediction rules which are used to drive the head mesh model along with the emotional speech simultaneously. The experiments intend to synthesize accurate emotional speech synchronized animation of articulators based on the system at phoneme level.
文章类型Article
关键词Articulatory Movement Hidden Markov Model Fully Context-dependent Modeling Emotional Speech
WOS标题词Science & Technology ; Technology
资助者National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150) ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150)
DOI10.1007/s11042-017-4578-0
关键词[WOS]SPEECH SYNTHESIS ; MOVEMENTS
收录类别SCI
语种英语
资助者National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150) ; National Natural Science Foundation of China(61572450 ; National Natural Science Foundation of China(61572450 ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Anhui Provincial Natural Science Foundation(1708085QF138) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Fundamental Research Funds for the Central Universities(WK2350000002) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Virtual Reality Technology and Systems, Beihang University(BUAA-VR-16KF-12) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; Open Funding Project of State Key Lab of Novel Software Technology, Nanjing University(KFKT2016B08) ; 61303150) ; 61303150)
WOS研究方向Computer Science ; Engineering
WOS类目Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号WOS:000407861800050
引用统计
文献类型期刊论文
条目标识符http://ir.hfcas.ac.cn:8080/handle/334002/33566
专题中科院合肥智能机械研究所
作者单位1.Univ Sci & Technol China, Dept Automat, Hefei, Anhui, Peoples R China
2.Chinese Acad Sci, Inst Intelligent Machines, Hefei, Anhui, Peoples R China
推荐引用方式
GB/T 7714
Yu, Lingyun,Yu, Jun,Wang, Zengfu. A realistic 3D articulatory animation system for emotional visual pronunciation[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2017,76(18):19241-19262.
APA Yu, Lingyun,Yu, Jun,&Wang, Zengfu.(2017).A realistic 3D articulatory animation system for emotional visual pronunciation.MULTIMEDIA TOOLS AND APPLICATIONS,76(18),19241-19262.
MLA Yu, Lingyun,et al."A realistic 3D articulatory animation system for emotional visual pronunciation".MULTIMEDIA TOOLS AND APPLICATIONS 76.18(2017):19241-19262.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Yu, Lingyun]的文章
[Yu, Jun]的文章
[Wang, Zengfu]的文章
百度学术
百度学术中相似的文章
[Yu, Lingyun]的文章
[Yu, Jun]的文章
[Wang, Zengfu]的文章
必应学术
必应学术中相似的文章
[Yu, Lingyun]的文章
[Yu, Jun]的文章
[Wang, Zengfu]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。