Tutor design for speech-based interfaces

Hakulinen, Jaakko; Turunen, Markku; Salonen, Esa-Pekka; Räihä, Kari-Jouko

doi:10.1145/1013115.1013137

Cited by 10 publications

(4 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These included corpus data (Derriks & Willems, 1998), focus groups (Cowan et al, 2017), user modelling (Schaffer et al, 2015), perceived sense of agency (Limerick et al, 2015) and physiological data (Kallinen & Ravaja, 2005). One paper was not explicitly clear in the methods for evaluating the iterative design of a tutor system, though it is assumed some form of interview was used (Hakulinen, Turunen, Salonen, & Räihä, 2004). The frequency of each data collection method is included in Table 5.…”

Section: Data Collection Methodsmentioning

confidence: 99%

“…One paper developed a system designed for healthcare workers to interact with a voice agent for multiple functions and presented the results of its deployment in a user study (Sammon et al, 2006). Hakulinen et al (2004) explored the design and iterative development of an integrated tutor for teaching new users to operate a speech-based email reading application. Finally, one paper had a different approach to design insight.…”

Section: Design Insightmentioning

confidence: 99%

See 1 more Smart Citation

The State of Speech in HCI: Trends, Themes and Challenges

Clark

Doyle

Garaialde

et al. 2019

Interacting With Computers

152

View full text Add to dashboard Cite

Speech interfaces are growing in popularity. Through a review of 68 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in HCI. We find that most studies are usability/theory-focused or explore wider system experiences, evaluating Wizard of Oz, prototypes, or developed systems by using self-report questionnaires to measure concepts like usability and user attitudes. A thematic analysis of the research found that speech HCI work focuses on nine key topics: system speech production, modality comparison, user speech production, assistive technology & accessibility, design insight, experiences with interactive voice response (IVR) systems, using speech technology for development, people's experiences with intelligent personal assistants (IPAs) and how user memory affects speech interface interaction. From these insights we identify gaps and challenges in speech research, notably the need to develop theories of speech interface interaction, grow critical mass in this domain, increase design work, and expand research from single to multiple user interaction contexts so as to reflect current use contexts. We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research. Author Keywords Speech interfaces; speech HCI; review; speech technology; voice user interfaces Research Highlights• Most papers focused on usability/theory-based or wider system experience research with a focus on Wizard of Oz and developed systems, though a lack of design work • Questionnaires on usability and user attitudes often used but few were reliable or validated • Thematic analysis showed nine primary research topics • Gaps in research critical mass, speech HCI theories, and multiple user contexts

show abstract

Section: Data Collection Methodsmentioning

confidence: 99%

Section: Design Insightmentioning

confidence: 99%

The State of Speech in HCI: Trends, Themes and Challenges

Clark

Doyle

Garaialde

et al. 2019

Interacting With Computers

152

View full text Add to dashboard Cite

show abstract

“…One of the main reasons for representing the knowledge of an expert is to enable non-experts (either human or machine) to accomplish tasks currently performed by experts. Efforts to create external representations have been used to inform the development of tutoring systems [5,6,10]. In these cases, the goal is to have the nonexpert understand or embody enough of the expert knowledge to enable them to use and manipulate it themselves.…”

Section: Related Workmentioning

confidence: 99%

Tactical Access to Complex Technology through Interactive Communication (TACTIC)

Samoylov

Franklin

Regli

et al. 2009

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Tactical Access to Complex Technology through Interactive Communication (TACTIC) is a user interface prototype developed under a technology effort designed to provide personnel deployed in the field with access to resources that typically require intercession by stationary experts with extensive training and experience. We present rationale behind a computer system that judiciously and beneficially exposes expert knowledge to novices, outline the domains in which such a system is applicable and describe a prototype interface implementation in the domain of military expeditionary forces.

show abstract

“…The first part, consisting of the basic functionality, takes about 5 min. The tutoring has been iteratively developed and user tested in three phases (Hakulinen et al, 2004).…”

Section: Manipulationmentioning

confidence: 99%

Evaluation of Software Tutoring for a Speech Interface

Hakulinen

Turunen

Räihä

2005

Int J Speech Technol

Self Cite

View full text Add to dashboard Cite

Speech applications are typically designed to be used without any instructions or manuals. More complex applications commonly come with web-based or printed manuals. An alternative approach, software tutoring, has been studied in the context of graphical user interfaces. In software tutoring, a software component guides users while they work with an application new to them. To evaluate the viability of software tutoring in speech-based applications a two-condition between-participants experiment (N = 18) was conducted. Participants learned to use a speech-based e-mail reading application and performed several tasks with it. In the first condition the e-mail application included an embedded tutoring component that guided the participants on using the application. In the second condition, a web manual was used. All interactions with the systems were recorded and annotated. Participants also filled in questionnaires that reported their attitudes towards the guidance they received and towards the e-mail reading application. The speech-based tutor performed equally well with web-based manual with no significant differences between the conditions on how well the participants managed to accomplish the tasks with the e-mail application or in participants' attitudes towards the application or the guidance. In addition, during the learning period the participants in the tutored condition had significantly fewer problems with the speech interface.

show abstract

Tutor design for speech-based interfaces

Cited by 10 publications

References 7 publications

The State of Speech in HCI: Trends, Themes and Challenges

The State of Speech in HCI: Trends, Themes and Challenges

Tactical Access to Complex Technology through Interactive Communication (TACTIC)

Evaluation of Software Tutoring for a Speech Interface

Contact Info

Product

Resources

About