“…To achieve the best possible result in heuristic evaluation in one of the diverse domains of computer systems available, it is therefore recommended to use an adapted set of heuristics. Examples of this are heuristics for augmented reality applications [5], information appliances [1], or game design [15]. Heuristics 3 and guidelines 4 exist in the areas of second screen and smart TV as well, but no statement is made about their validity in the respective studies.…”
Section: Overview On Heuristic Evaluationmentioning
confidence: 99%
“…In an evaluation-based approach, general usability problems with certain systems are categorized in heuristics. This type of derivation is based on empirical observations, often dependent on the examined object and therefore less suitable for the derivation of generic heuristics ( [1], p. 278). The research-based approach identifies requirements and key factors of a specific domain based on appropriate literature.…”
Section: Development Of the Heuristicsmentioning
confidence: 99%
“…A total of 66 points were created, of which 51 were then incorporated into the previously created first-level heuristics for better overview. Due to their concrete and practical nature, guidelines are well suited for extending heuristics to be more precise ( [1], p. 277), which is why they were combined with the previously gained findings from the focus group. The result of the heuristic checklist for second screen applications is described in section 4.2.…”
Section: Derivation Of the Heuristic Checklist For Second Screen Appl...mentioning
confidence: 99%
“…In order to generate as complete a list of usability problems as possible in a particular system, it makes sense to use an adapted set of heuristics for the respective domain ( [10], p. 183). Examples for already adapted heuristics are augmented reality applications [5], information appliances [1] or game design [15]. Heuristics 1 and guidelines 2 already exist in the area of second screen and smart TV, but no statement is made about their quality in the respective works.…”
Section: Introductionmentioning
confidence: 99%
“…One of the most criticized aspects of heuristic evaluation is the loose and unstructured evaluation process ( [10], p. 182) and the different interpretation of general formulated heuristics by users ( [1], p. 277). In order to counteract these problems and to keep the scope of more precise heuristics manageable, a checklist was developed for the heuristics for second screen applications, which contains concrete and concise instructions for the user in order to enable efficient and comprehensive identification of usability problems ( [13], 249f.…”
This paper presents domain-specific heuristics for second screen applications and the development of a heuristics checklist to enable a more intuitive and structured application of the created heuristics. The heuristics presented were developed on the basis of Nielsen [12] Ten Usability Heuristics in a research-based approach using specific literature and a focus group. In order to evaluate the quality of the derived checklist, a heuristic evaluation of a second screen application with five users was carried out and its results compared to a user study with 20 participants. This resulted in an average validity of 0.5 and a high completeness of 0.74. The harmonic mean of these values results in an F-measure of 0.6 with an equal weighting. This value speaks for a sufficient validity of the created heuristic checklist in the first iteration.
“…To achieve the best possible result in heuristic evaluation in one of the diverse domains of computer systems available, it is therefore recommended to use an adapted set of heuristics. Examples of this are heuristics for augmented reality applications [5], information appliances [1], or game design [15]. Heuristics 3 and guidelines 4 exist in the areas of second screen and smart TV as well, but no statement is made about their validity in the respective studies.…”
Section: Overview On Heuristic Evaluationmentioning
confidence: 99%
“…In an evaluation-based approach, general usability problems with certain systems are categorized in heuristics. This type of derivation is based on empirical observations, often dependent on the examined object and therefore less suitable for the derivation of generic heuristics ( [1], p. 278). The research-based approach identifies requirements and key factors of a specific domain based on appropriate literature.…”
Section: Development Of the Heuristicsmentioning
confidence: 99%
“…A total of 66 points were created, of which 51 were then incorporated into the previously created first-level heuristics for better overview. Due to their concrete and practical nature, guidelines are well suited for extending heuristics to be more precise ( [1], p. 277), which is why they were combined with the previously gained findings from the focus group. The result of the heuristic checklist for second screen applications is described in section 4.2.…”
Section: Derivation Of the Heuristic Checklist For Second Screen Appl...mentioning
confidence: 99%
“…In order to generate as complete a list of usability problems as possible in a particular system, it makes sense to use an adapted set of heuristics for the respective domain ( [10], p. 183). Examples for already adapted heuristics are augmented reality applications [5], information appliances [1] or game design [15]. Heuristics 1 and guidelines 2 already exist in the area of second screen and smart TV, but no statement is made about their quality in the respective works.…”
Section: Introductionmentioning
confidence: 99%
“…One of the most criticized aspects of heuristic evaluation is the loose and unstructured evaluation process ( [10], p. 182) and the different interpretation of general formulated heuristics by users ( [1], p. 277). In order to counteract these problems and to keep the scope of more precise heuristics manageable, a checklist was developed for the heuristics for second screen applications, which contains concrete and concise instructions for the user in order to enable efficient and comprehensive identification of usability problems ( [13], 249f.…”
This paper presents domain-specific heuristics for second screen applications and the development of a heuristics checklist to enable a more intuitive and structured application of the created heuristics. The heuristics presented were developed on the basis of Nielsen [12] Ten Usability Heuristics in a research-based approach using specific literature and a focus group. In order to evaluate the quality of the derived checklist, a heuristic evaluation of a second screen application with five users was carried out and its results compared to a user study with 20 participants. This resulted in an average validity of 0.5 and a high completeness of 0.74. The harmonic mean of these values results in an F-measure of 0.6 with an equal weighting. This value speaks for a sufficient validity of the created heuristic checklist in the first iteration.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.