Assessing Subjective Quality of Web Interaction with Neural Network as Context of Use Model

Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s Usability

“…Despite being acceptable to check the interface implemented at the interaction level, its use entails multiple consequences, such as (1) the dependence on real users and an already testable interface and (2) the results reliability and the significant number of samples required to ensure the process viability. In terms of architecture, these solutions usually delegate the sample processing and analysis to a remote server, but inherent performance drawbacks have led to the adoption of a new approach in which the load is divided between server and client accordingly with the objective of improving the results' response times [59][60][61][62][63] (ii) Metric-based: an approach focused on the definition metrics used to quantify the interface's compliance level with usability guidelines defined in literature. These solutions do not require the intervention of end-users, which make them a viable option to be used in the interface's development initial stages.…”

“…These solutions do not require the intervention of end-users, which make them a viable option to be used in the interface's development initial stages. Despite the correlation shown between the approaches and the manual tests outcomes, the metrics' lack of context awareness and their overall dependence on expert's know-how compromise their adoption in multiple use cases [59][60][61] (iii) Model-based: an approach developed to mitigate the drawbacks identified in the metric-and interaction-based approaches through the use of artificial intelligence mechanisms; this allows for the definition of the interaction model then applied in the evaluation process. Features which make it independent from end-users enhance its context awareness.…”

“…Features which make it independent from end-users enhance its context awareness. Although efforts have been made to enhance the model's creation and training algorithms and their context adaptability, current solution scalability and performance still need improvement before being implemented in a real environment [59][60][61]64] 4 Human Behavior and Emerging Technologies (iv) Hybrid-based: an approach that combines the mechanisms of each of the previously described categories to provide a holistic solution capable of identifying usability flaws and proposing measures to address them [59,60] Despite their differences, there is a common denominator among the categories defined-the automation mechanisms-which aim to reduce the number of tasks to be handled by a human agent. Based on such typification, a development effort has been performed by both the scientific and industry community to create solutions capable of evaluating to a certain degree in the interface's usability.…”

“…In the academic context, an analysis performed to 99 scientific articles ranging from 1997 to 2022 provided an overview of the heuristic methodology evolution tendency and respective trends explored throughout the years [60,[62][63][64] (see Figures 2 and 3).…”