Mmdagent&amp;#x2014;A fully open-source toolkit for voice interaction systems

Lee, Akinobu; Oura, Keiichiro; Tokuda, Keiichi

doi:10.1109/icassp.2013.6639300

Cited by 62 publications

(25 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…1. It is possible to run MMDAgent on PCs [1] and smartphones [25] using operating systems such as Windows, Mac OS, Linux, iOS, and Android. MMDAgent uses Open JTalk [26] as its speech synthesis engine, Julius [27] as its speech recognition engine, MikuMikuDance [28] as its 3D model format, and Bullet Physics [29] as its physical operation engine.…”

Section: Mmdagent Toolkitmentioning

confidence: 99%

Web-based environment for user generation of spoken dialog for virtual assistants

Nishimura

Yamamoto

Uchiya

et al. 2018

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

In this paper, a web-based spoken dialog generation environment which enables users to edit dialogs with a video virtual assistant is developed and to also select the 3D motions and tone of voice for the assistant. In our proposed system, "anyone" can "easily" post/edit contents of the dialog for the dialog system. The dialog type corresponding to the system is limited to the question-and-answer type dialog, in order to avoid editing conflicts caused by editing by multiple users. The spoken dialog sharing service and FST generator generates spoken dialog content for the MMDAgent spoken dialog system toolkit, which includes a speech recognizer, a dialog control unit, a speech synthesizer, and a virtual agent. For dialog content creation, question-and-answer dialogs posted by users and FST templates are used. The proposed system was operated for more than a year in a student lounge at the Nagoya Institute of Technology, where users added more than 500 dialogs during the experiment. Images were also registered to 65% of the postings. The most posted category is related to "animation, video games, manga." The system was subjected to open examination by tourist information staff who had no prior experience with spoken dialog systems. Based on their impressions of tourist use of the dialog system, they shortened the length of some of the system's responses and added pauses to the longer responses to make them easier to understand.

show abstract

Section: Mmdagent Toolkitmentioning

confidence: 99%

Web-based environment for user generation of spoken dialog for virtual assistants

Nishimura

Yamamoto

Uchiya

et al. 2018

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

show abstract

“…Microsoft Lync, which has a video call function and the ability to transfer the current call to any contact, is used as the VoIP client software. We adopted the MMDAgent spoken dialogue system [3] as the virtual telephone operator.…”

Section: Proposed Systemmentioning

confidence: 99%

“…To develop the SDS, we adopted a fully open-source toolkit for voice interaction systems (MMDAgent [3]) using speech processing technology. As a practical example, digital signage has been set up in front of the main gate of a university (Nagoya Institute of Technology) [4], allowing anyone to interact with a life-size three-dimensional (3D) character named 'Mei-chan' ( Figure 3).…”

Section: Cooperation With the Spoken Dialogue Systemmentioning

confidence: 99%

A VoIP-based voice interaction system for a virtual telephone operator using video calls

Nishimura

Sugiokay

Yamamoto

et al. 2014

2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE)

View full text Add to dashboard Cite

We have developed a telephone operator system using a spoken dialogue system. The system can be used for video calls, with Microsoft Lync used as the VoIP client. The spoken dialogue system is used in the system to display a 3D character, and to interact with the user over the video call. In this study, the interactive scenario for the telephone operator is automatically generated from a university employee database. Experimental results from subjects using the system showed good system performance.

show abstract

“…In the last two decades, a variety of spoken dialogue systems (SDSs) with embodied conversational agents (ECAs) have been developed [1][2][3][4][5][6]. In those SDSs, human agents talked to and listened to users on a screen and the agants can play the roles of salesman, language teacher, medical doctor, etc.…”

Section: Introductionmentioning

confidence: 99%

A Comparative Study of Statistical Conversion of Face to Voice Based on Their Subjective Impressions

Ohsugi¹,

Saito

Minematsu

2018

Interspeech 2018

View full text Add to dashboard Cite

Recently, various types of Voice-based User Interfaces (VUIs) including smart speakers have been developed to be on the market. However, many of the VUIs use only synthetic voices to provide information for users. To realize a more natural interface, one feasible solution will be personifying VUIs by adding visual features such as face, but what kind of face is suited to a given quality of voice or what kind of voice quality is suited to a given face? In this paper, we test methods of statistical conversion from face to voice based on their subjective impressions. To this end, six combinations of two types of face features, one type of speech features, and three types of conversion models are tested using a parallel corpus developed based on subjective mapping from face features to voice features. The experimental results show that each subject judge one specific and subjectdependent voice quality as suited to different faces, and that the optimal number of mixtures of face features is different from the numbers of mixtures of voice features tested.

show abstract

Mmdagent—A fully open-source toolkit for voice interaction systems

Cited by 62 publications

References 8 publications

Web-based environment for user generation of spoken dialog for virtual assistants

Web-based environment for user generation of spoken dialog for virtual assistants

A VoIP-based voice interaction system for a virtual telephone operator using video calls

A Comparative Study of Statistical Conversion of Face to Voice Based on Their Subjective Impressions

Contact Info

Product

Resources

About