Abstract. This paper describes a comparative empirical evaluation study that uses multimodal presentations to communicate review messages in an e-commerce platform. Previous studies demonstrate the effective use of multimodality in different problem domains (e.g. e-learning). In this paper, multimodality and expressive avatars are used to communicate information related to product reviews messages. The data of the reviews was opportunistically collected from Facebook and Twitter. Two independent groups of users were used to evaluate two different presentations of reviews and ratings using as a basis an experimental e-commerce platform. The control group used a text-based with emojis presentation and the experimental group used a multimodal approach based on expressive avatars. Three parameters of usability were measured. These were efficiency, effectiveness, user satisfaction, and user preference. The result showed that the two approaches performed similarly. These findings provide a basis for further experiments in which text, emojis and expressive avatars can be combine to communicate a larger volume of reviews and ratings.Keywords: Multimodality, Expressive Avatars, e-Commerce, Usability, Social Media, Reviews, Effectiveness, Efficiency, User Satisfaction.
IntroductionThe Web increases accessibility and removes geographical barriers [1]. As more people use the Internet for on-line transactions, the need for effective, efficient and user satisfying e-commerce interfaces becomes significant. Product reviews and ratings need to be easily understood by users. Therefore, issues such as usability of the presentation, accessibility and clarity contribute to the decision making of users. Good exemplars of good design would require fewer users 'clicks' and display transitions. The term "modality" refers to the use of human senses (e.g. vision, hearing, touch, smell and taste) [2]. Currently, commercial e-commerce interfaces predominantly use visual means to communicate information. This often results to a visual information overload. The introduction of the new web technologies (Web 2.0) facilitated additional capabilities for users. Users can easily publish opinions, beliefs and thoughts globally accessible by the social media. Ratings can be shared through social media in platforms such as Facebook and Twitter. This paper presents a brief overview of literature relating to e-commerce, social media, user reviews, emojis and multimodality. It also describes the experimental e-commerce platform developed, the experimental design, results and conclusions.
2E-commerce, Social Media and Multimodality
E-commerceE-commerce can be defined as "the use of the Internet and other networking technologies for conducting business transactions" [3]. An organisation is considered to be ebusiness functioning when most (or a significant proportion) of its business is delivered electronically. Exchanging information is often enabled through the use of information technology (IT) [4] and lowers the cost of exchanging information [5,6]. G...