Using think-aloud and psychometrics to explore users’ experience with a news Web site

Aranyi, Gabor; Schaik, Paul van; Barker, Philip

doi:10.1016/j.intcom.2012.01.001

Cited by 19 publications

(27 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Aranyi et al. () confirmed these connections between the classical and expressive aesthetics dimensions and product attributes. However, here the two aesthetics dimensions did not reproduce in the measurement model and a composite of the two scales was identified as a psychometrically justified solution to measure aesthetics.…”

Section: Discussionmentioning

confidence: 81%

“…An online questionnaire was designed to collect responses to items as indicators of variables measuring aspects of users' experience with news sites. The selection of measures for modeling UX with news sites was guided by (a) an exploratory study that was conducted to identify self‐reported factors of UX of participants using a particular news site under think‐aloud instructions (Aranyi et al., ), and (b) by a literature review of models of technology acceptance and UX (see Aranyi, ). Protocol analysis of the think‐aloud recordings in the exploratory study yielded five categories of experience: content, layout, information architecture, diversion, and impression.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Modeling user experience with news websites

Aranyi

Schaik

2015

Asso for Info Science & Tech

Self Cite

View full text Add to dashboard Cite

Telephone: +44 1642 342320Modeling user-experience with news Web sites 2 ABSTRACT Although news Web sites are used by a large and increasing number of people, there is a lack of research within human-computer interaction regarding users' experience with this type of interactive technology. In the current research, existing measures to user-experience factors were identified and, using an online survey, answers to psychometric scales to measure Web-site characteristics, need fulfilment, affective reactions, and constructs of technology acceptance and userexperience were collected from regular users of news sites. A comprehensive userexperience model was formulated to explain acceptance and quality judgements of news sites. The main contribution of the current study is the application of influential models of user-experience and technology acceptance to the domain of online news.By integrating both types of variable in a comprehensive model, the relationships between the types of variable are clarified both theoretically and empirically. Implications of the model for theory, further research and system design are discussed.

show abstract

Section: Discussionmentioning

confidence: 81%

Section: Methodsmentioning

confidence: 99%

Modeling user experience with news websites

Aranyi

Schaik

2015

Asso for Info Science & Tech

Self Cite

View full text Add to dashboard Cite

show abstract

“…As shown in Table 2 there are clear differences in the average number of words participants generated in the three think aloud conditions. The coding scheme used to code all 45 transcripts was generated based on several studies relating to website usability (Aranyi et al, 2012;Cooke, 2010;Damico & Balidon, 2007;van Gog et al, 2005;Tan & Wei, 2006;Zhao & McDonald, 2010), teacher planning and decision making (Kansanen et al, 2000;Moos, 2014), and Ericsson and Simon's levels of verbalizations and suggested statements (1984). The final coding scheme used to code all 45 transcripts includes 11 categories.…”

Section: Discussionmentioning

confidence: 99%

“…Usability researchers most often employ the concurrent and retrospective think aloud methods to gain insight into web seeking behaviors and to evaluate a website's content and ease of use (Aranyi, Schaik, & Barker, 2012;Barzilai & Zohar, 2012;Branch, 2006;Kuusela & Paul, 2000). During the concurrent procedure participants verbalize their thoughts aloud while they simultaneously complete a task.…”

Section: Literature Reviewmentioning

confidence: 99%

“…For instance, Aranyi and his colleagues (2012) conducted an exploratory study of interaction experience with a news website. The concurrent think aloud yielded five categories of experience based on the participants' evaluative statements: impression, content, layout, information, architecture, and diversion (Aranyi et al, 2012). Similarly, Barzilai and Zohar (2012) utilized the concurrent procedure to examine epistemic thinking in action.…”

Section: Literature Reviewmentioning

confidence: 99%

See 1 more Smart Citation

Understanding Teachers’ Cognitive Processes during Online Professional Learning: A Methodological Comparison

Beach

Willows

2017

OLJ

View full text Add to dashboard Cite

This study examined the effectiveness of three types of think aloud methods for understanding elementary teachers' cognitive processes as they used a professional development website. A methodology combining a retrospective think aloud procedure with screen capture technology (referred to as the virtual revisit) was compared with concurrent and retrospective think aloud procedures. Elementary teachers from a large metropolitan area were assigned to one of the three think aloud conditions (N = 45). Participants in the concurrent condition verbalized their thoughts while simultaneously navigating a professional development website for 20 minutes. Participants in the retrospective condition verbalized their thoughts following their 20-minute website navigation without any aids. Finally, participants in the virtual revisit condition verbalized their thoughts while viewing a screen recording of their website navigation. Think aloud protocols were analyzed to determine the frequency of cognitive processes verbalized by participants in each condition. The findings of this study indicated significant differences in the types of verbalizations produced by participants across the three think aloud conditions. In addition, findings reveal benefits and limitations of employing each type of think aloud method in the context of a professional development website.

show abstract

Testing a model of user‐experience with news websites

Aranyi

Schaik

2015

Asso for Info Science & Tech

Self Cite

View full text Add to dashboard Cite

Although the Internet has become a major source for accessing news, there is little research regarding users' experience with news sites. We conducted an experiment to test a comprehensive model of user experience with news sites that was developed previously by means of an online survey. Level of adoption (novel or adopted site) was controlled with a between-subjects manipulation. We collected participants' answers to psychometric scales at 2 times: after presentation of 5 screenshots of a news site and directly after 10 minutes of hands-on experience with the site. The model was extended with the prediction of users' satisfaction with news sites as a high-level design goal. A psychometric measure of trust in news providers was developed and added to the model to better predict people's intention to use particular news sites. The model presented in this article represents a theoretically founded, empirically tested basis for evaluating news websites, and it holds theoretical relevance to user-experience research in general. Finally, the findings and the model are applied to provide practical guidance in design prioritization. IntroductionNews media have had a constantly increasing web presence since the middle of the 1990s, when most of the major news providers in the Western world launched online versions of their newspapers. More recently, with the rapid spread of handheld electronic devices, such as tablet computers, smart phones, and e-book readers, online publishing has become a major source of media use. For example, by August 2012, sales of electronic books on Amazon surpassed those of print books by 14%, including print books with no electronic editions and excluding free electronic books (Malik, 2012). With regard to the decline of print news publishing in the United States, Mitchell and Rosenstiel (2012) report that, in 2011, losses in print advertising revenue outweighed gains in online advertising revenue 10 to 1, and that in terms of the combined circulation and advertising revenue, the print-newspaper sector has shrunk by 43% since 2000. The increase in the use of online news, as opposed to print news, is not attributable only to the spread of Internet-enabled handheld devices. Mitchell and Rosenstiel also point out that 8 in 10 people who access news on smart phones or tablets also access news on conventional computers. News sites are becoming the primary source of accessing news and daily information. The success of interactive products, such as news sites, is largely influenced by the extent to which they promote positive experiences in their users (Law & van Schaik, 2010). Indeed, research in user experience (UX) is primarily motivated by the notion that high-quality experiences with interactive products promote the adoption and repeated use of these products (Hassenzahl, 2003). Model of UX with News SitesNews sites differ from other types of websites in many aspects, which carry important implications to their use, experience of use, evaluation, and quality criteria. News sites are a specific ...

show abstract

Using think-aloud and psychometrics to explore users’ experience with a news Web site

Cited by 19 publications

References 22 publications

Modeling user experience with news websites

Modeling user experience with news websites

Understanding Teachers’ Cognitive Processes during Online Professional Learning: A Methodological Comparison

Testing a model of user‐experience with news websites

Contact Info

Product

Resources

About