Integrating Mobile Multimodal Interactions based on Programming By Demonstration​

Bellal, Zouhir; Elouali, Nadia; Benslimane, Sidi Mohamed; Acartürk, Cengiz

doi:10.1080/10447318.2020.1823688

Cited by 6 publications

(2 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Subsequently, these interactions can be automatically reproduced without any human action, which can be a method to limit task fragmentation. On-the-Fly Interaction Editor (OFIE) [63] relies on Programming By Demonstration to define the appropriate native input to be performed automatically when the rule is triggered. The approach enables the end-user to define actions by simply performing the required native input interaction on the Graphical User Interface of the application.…”

Section: Web Augmentationmentioning

confidence: 99%

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

2021

View full text Add to dashboard Cite

The use of the World Wide Web has experienced extraordinary growth in the last decades. The Web has become the main source of information for millions of users. The number of websites offering content to users is countless. In order to personalise information according to their needs, users often have to visit multiple, unconnected pages. Users perform a number of actions to collect that information that requires concentration. If the number of Web resources is large, the activity becomes unpleasant. The problem increases when these tasks are performed frequently and repetitively. These tasks are time-consuming and lead users to experience frustration and disorientation during the activity, causing a loss of concentration that prolongs the activity over time. Web Augmentation combines different Web technologies to improve user experience on existing pages by adding content from different pages among other benefits. This article proposes Web Augmentation as a technique to reduce user interactions in repetitive tasks. To support the proposal, the paper introduces Excore, a browser extension for Web Augmentation that allows end-users to add content from different resources automatically. The article presents the benefits introduced by this approach as a response to the drawbacks experienced by users while performing their activities on the Web. The architecture of the platform and its operations are described by means of an example. A double evaluation of the extension is addressed, one qualitative and one quantitative. The results show that Excore reduces the number of interactions by 94.45% and the time to complete a task by 80.75%.

show abstract

Section: Web Augmentationmentioning

confidence: 99%

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

2021

View full text Add to dashboard Cite

show abstract

“…Due to the convenience of smart technologies, the incorporation of functionalities to enhance the affective UX of mobile devices [12,13] is more popular rather than desktop systems [14], especially due to the ability to integrate mobile multimodal interactions [15]. Many applications were developed by taking user emotions and the context into account to produce effective and affective usable systems through personalization and customization.…”

Section: Introductionmentioning

confidence: 99%

Emotional Keyboard: To Provide Adaptive Functionalities Based on the Current User Emotion and the Context

Wattearachchi¹,

Hewagamage²,

Hettiarachchi³

2022

IxD&A

View full text Add to dashboard Cite

Improving the User Experience (UX) of mobile devices is of vital importance due to the advent of emerging technologies and the prevalence of using mobile devices. This research aims to develop a model for a mobile device that can suggest adaptive functionalities, based on the current user emotion and the context by changing the user’s negative emotions (sadness and anger) into positive ones. As a proof of concept, a keyboard named “Emotional Keyboard” was developed through five prototypes iteratively using Evolutionary Prototyping. Action Research was adopted as the methodology along with User-Centered Design (UCD) which further included two user surveys. The first three prototypes were implemented to decide the most optimal perception from facial expressions and text analytics. Subsequent prototypes provided affective functions to the user such as listening to music, playing a game, chat with friends, based on the detected negative emotion and the context. The evaluation of each of the prototypes was performed iteratively with user participation. The final (fifth) prototype evaluation was done in two phases, an individual analysis (to measure the performance of each user separately), and an overall analysis (a general analysis that averaged all the results from individual analysis and measured the performance of the overall model). Results of both analyses showed that eventually the Emotional Keyboard was able to predict the adaptive functions correctly to the user and it did not terminate its learning process where the users’ feedback was continuously used to improve its performance. In conclusion, an “Adaptive System with User Control” was developed thus improving the acceptability and usability of a mobile device which aligns with the research aim.

show abstract

MAWA: A Browser Extension for Mobile Web Augmentation

Aldalur

Pérez

Larrinaga

2021

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Integrating Mobile Multimodal Interactions based on Programming By Demonstration

Cited by 6 publications

References 36 publications

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

Emotional Keyboard: To Provide Adaptive Functionalities Based on the Current User Emotion and the Context

MAWA: A Browser Extension for Mobile Web Augmentation

Contact Info

Product

Resources

About

Integrating Mobile Multimodal Interactions based on Programming By Demonstration​

Cited by 6 publications

References 36 publications

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

Web Augmentation as a Technique to Diminish User Interactions in Repetitive Tasks

Emotional Keyboard: To Provide Adaptive Functionalities Based on the Current User Emotion and the Context

MAWA: A Browser Extension for Mobile Web Augmentation

Contact Info

Product

Resources

About

Integrating Mobile Multimodal Interactions based on Programming By Demonstration