Automatic support for web user studies with SCONE and TEA

Obendorf, Hartmut; Weinreich, Harald; Hass, Torsten

doi:10.1145/985921.986007

Cited by 15 publications

(7 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Past attempts of automation have also resulted in tools that are too specific and application-related, but very costly and oversimplified [5], such as TEA [6], which can only collect user data. They can not analyze user data.…”

Section: User Experience Research Toolsmentioning

confidence: 99%

Application of CAUX in Remote Evaluation of Websites

Wang¹,

Liu

2018

Proceedings of Information Science and Cloud Computing — PoS(ISCC 2017)

View full text Add to dashboard Cite

In order to address problems of recording data in a complex way and utilizing unreal scene in traditional methods, the author proposes a method about remote evaluation of websites by using the Context-Awareness User Experience tool. This method helps researchers get the user data from real environment. The CAUX tool can collect user data automatically without disturbance, and it can also make semi-automated analysis of the data to reduce the burden on UX researchers. The CAUX tool needs to be installed in the user's mobile phone in advance. It can collect data of the situation about users according to the collection rules set by the UX researcher. The user data, which include objective data, URL sequences, screenshot etc, can be uploaded to the server database automatically for storage. These data can also be presented in a visual interface. Then UX researchers analyse them to figure out usability problems. In this paper, the author applies the CAUX tool to a case to study the feasibility of the remote user experience evaluation method. The case is selected as the website of Dalian maritime university. The results indicate that the application of CAUX tool in analysing user experience about remote mobile site can be more realistic and objective. Also, the data are shown in a form of visualization so as to improve UX researchers data analysis efficiency and help UX researchers conduct user experience research more effectively. ISCC2017

show abstract

Section: User Experience Research Toolsmentioning

confidence: 99%

Application of CAUX in Remote Evaluation of Websites

Wang¹,

Liu

2018

Proceedings of Information Science and Cloud Computing — PoS(ISCC 2017)

View full text Add to dashboard Cite

show abstract

“…Software tools analyze these captured data afterwards. There are some tools already developed to perform this kind of usability evaluation as: WebVip [16], WET [8], TEA [12] and UsaProxy [3], which just perform the capture of users data but do not analyze it. WebVip and TEA logs are similar to web server logs, with no detailed information about actions performed by users such as, mouse clicks and mouse movements.…”

Section: Related Workmentioning

confidence: 99%

“…Furthermore, analyzing the behavior of a few users hinders a quantitative analysis giving to the evaluation just a qualitative feature. Some problems could just be highlighted in a quantitative analysis and also the impact of them could just be evaluated analyzing a large number of users [9,12]. Another important factor when the usability of an interface is evaluated is its context of usage, which is difficult to simulate in a user test made in a laboratory.…”

Section: Introductionmentioning

confidence: 99%

A method for remote and semi-automatic usability evaluation of web-based applications through users behavior analysis

Vargas

Weffers

Rocha

2010

Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research

View full text Add to dashboard Cite

In this paper we describe a method for evaluating the usability of web-based applications. Our method is based on remote and automatic capture and semi-automatic analysis of users behavior, in order to find usability problems in the applications' interfaces. The goal of our method is to allow an analysis of the way users actually interact with the evaluated interface. Through the analysis of users behavior is possible to find patterns of interaction. Analyzing the patterns found and comparing it to the expected behavior for the tasks performed by users, we can detect usability problems. In this paper we also briefly describe a first experiment with our method and some initial results that point to the potential of the method in performing remote and automatic usability evaluations.

show abstract

“…Unfortunately, due to changes in the security model of current web browsers, the system would no longer work today. SCONE/TEA [6] concentrates on test automation. The log data does not feature the level of detail created by UsaProxy (e.g.…”

Section: Related Workmentioning

confidence: 99%

Tracking the interaction of users with AJAX applications for usability testing

Atterer¹,

Schmidt

2007

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

In this paper, we introduce an implementation for detailed monitoring of user actions on web pages. It addresses the problem that the log data recorded by standard web servers is not sufficient for the tracking of users on AJAX websites, e.g. to conduct a usability test. Using standard web technologies, our HTTP proxy can record very detailed usage information, such as mouse movements, clicks, key presses and scrolling, together with the exact HTML DOM tree objects involved. As we show in several case studies, the tracking also works across multiple websites, none of which needs to be under our control. This approach is much less invasive than previous efforts: The test person does not need to install software on her computer, and in certain operation modes, no configuration changes at all are required on her computer. Our research indicates that if the technology described in this paper is employed, arbitrary visitors of a website are more likely to take part in a usability test offered by that site -this facilitates recruiting test participants over the Internet.

show abstract

Automatic support for web user studies with SCONE and TEA

Cited by 15 publications

References 12 publications

Application of CAUX in Remote Evaluation of Websites

Application of CAUX in Remote Evaluation of Websites

A method for remote and semi-automatic usability evaluation of web-based applications through users behavior analysis

Tracking the interaction of users with AJAX applications for usability testing

Contact Info

Product

Resources

About