Usability Evaluation of TV Interfaces: Subjective Evaluation Vs. Objective Evaluation

Gümüşsoy, Çiğdem Altın; Pekpazar, Aycan; Esengün, Mustafa; Bayraktaroglu, Ayse Elvan; İnce, Gökhan

doi:10.1080/10447318.2021.1960093

Cited by 19 publications

(6 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Practically, the two evaluation strategies have their leanings. To minimize the repercussion of their defects, under a particular circumstance, there are scholars wedded to incorporating the two assessment methods together, in the hope that the results can be much fairer as well as more reliable [1][2][3]. Nevertheless, in many scenarios, objective evaluation data is hard to obtain, and many a strength of subjective evaluation make it a more practical means.…”

Section: Introductionmentioning

confidence: 99%

Abnormal-Aware Multiperson Evaluation System with Improved Fuzzy Weighting

2022

Journal of Function Spaces

View full text Add to dashboard Cite

There exists a phenomenon that subjectivity highly lies in the daily evaluation process. Our research primarily concentrates on a multiperson evaluation system with anomaly detection to minimize the possible inaccuracy that subjective assessment brings. We choose the two-stage screening method, which consists of rough screening and score-weighted Kendall-τ distance to winnow out abnormal data, coupled with hypothesis testing to narrow global discrepancy. Then we use fuzzy synthetic evaluation method (FSE) to determine the significance of scores given by reviewers as well as their reliability, culminating in a more impartial weight for each reviewer in the final conclusion. The results demonstrate a clear and comprehensive ranking instead of unilateral scores, and we get to have an efficiency in filtering out abnormal data as well as a reasonably objective weight determination mechanism. We can sense that through our study, people will have a chance of modifying a multiperson evaluation system to attain both equity and a relatively superior competitive atmosphere. A preprint has previously been published (Ni, 2022).

show abstract

Section: Introductionmentioning

confidence: 99%

Abnormal-Aware Multiperson Evaluation System with Improved Fuzzy Weighting

2022

Journal of Function Spaces

View full text Add to dashboard Cite

show abstract

“…Awale and Murano [30] evaluated the Apple TV interface against Nielsen's heuristics, while Bures et al [31] introduced an automated model-based approach for usability testing. Gumussoy et al [33] conducted a usability test using the concurrent think-aloud method, surveys, eye tracking, expression analysis, and logging techniques, investigating the relationships between usability metrics in TV-related studies.…”

Section: Literature Reviewmentioning

confidence: 99%

“…In the studies that conducted user tests for TV and similar systems [18,20,24,[26][27][28]31,33], specific usability problems related to the tested system were identified. However, these studies did not propose any general principles for the design of TV systems.…”

Section: Literature Reviewmentioning

confidence: 99%

“…In the literature, there is a limited number of studies investigating the usability of video streaming and OTT platforms (e.g., [12][13][14][15][16][17]). On the other hand, there is a more significant number of studies in the literature concerning the evaluation of the usability of TV and similar systems (e.g., [18][19][20][21][22][23][24][25][26][27][28][29][30][31][32][33]). Most existing studies have examined the usability of OTT platforms, video-on-demand (VOD) systems, TV, and similar systems through user testing, field research, and heuristic evaluation.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Conceptualization and Survey Instrument Development for Over-the-Top Platforms’ Usability

Pekpazar,

Coskun,

Altin Gumussoy

2023

JTAER

Self Cite

View full text Add to dashboard Cite

OTT (over-the-top) streaming is a subscription-based video service model that delivers video-on-demand content, films, and series directly to end-users over the Internet, bypassing the need for traditional satellite receiver systems. The most popular OTT service providers include Netflix, Hulu, Amazon Prime, and Disney+. During the COVID-19 pandemic, the viewership rates and subscriber numbers for OTT platforms rapidly increased. Like various other products and systems, usability problems can substantially impact user satisfaction, loyalty, and the intention to continue using OTT services. Therefore, this study aimed to conceptualize the usability of OTT platforms and develop an OTT Usability Measurement Scale for the usability evaluation of OTT platforms based on the Apple tvOS Guidelines and the literature. OTT platform usability was conceptualized with nine constructs, including Accessibility and Customization, Account Management, Data Entry and Search, Branding, Privacy, Navigation, Help, Content, and Design, and the concepts were measured with a scale including 48 items. The validity of the developed scale was tested through two separate survey studies conducted with Netflix web application users. The first survey involved 650 participants. At this stage, an exploratory factor analysis was used to evaluate the scale’s measurement properties, and the developed factor structure was confirmed. In the second stage, a survey with 600 participants was conducted, and a confirmatory factor analysis was applied to validate the scale properties. Furthermore, a nomological validation of the developed scale was performed, examining the relationship between the acquired OTT factors and elements such as continued intention to use, satisfaction, and brand loyalty. As a result of the nomological validation, it was observed that the privacy and design factors significantly affected each of the three dependent variables.

show abstract

“…However, a general lack of standardized evaluation criteria in current methods may lead to inconsistent findings. Moreover, both subjective and experimental approaches are typically only conducted after the design is completed, which restricts their applicability in fast, large-scale assessments [14,15].…”

Section: Introductionmentioning

confidence: 99%

Image Entropy-Based Interface Evaluation Method for Nuclear Power Plants

Tang,

Chen,

Lin

et al. 2023

Entropy

View full text Add to dashboard Cite

The digital interface is crucial for nuclear plant operators, influencing their decision-making significantly. However, evaluations of these interfaces often overlook users’ decision-making performance; lack established standards, typically occurring after the design phase; and are unsuitable for large-scale assessments. Recognizing the vital role of interface information, this paper built on our previous research and proposed a method tailored for nuclear power plant interfaces, utilizing image entropy to evaluate the impact of information on decision-making. A comparative analysis with an experimental evaluation method empirically validated the effectiveness of the proposed method. This research offers a unique decision-making-centric method to interface evaluation, providing a standardized, adaptable framework for various design phases and enabling extensive and rapid evaluations.

show abstract

Usability Evaluation of TV Interfaces: Subjective Evaluation Vs. Objective Evaluation

Cited by 19 publications

References 40 publications

Abnormal-Aware Multiperson Evaluation System with Improved Fuzzy Weighting

Abnormal-Aware Multiperson Evaluation System with Improved Fuzzy Weighting

Conceptualization and Survey Instrument Development for Over-the-Top Platforms’ Usability

Image Entropy-Based Interface Evaluation Method for Nuclear Power Plants

Contact Info

Product

Resources

About