BACKGROUND
The use of Mobile Applications (apps) for managing overweightness/obesity has increased over recent years. However, there is a lack of evidence on the efficacy, effectiveness and safety of these apps. The EVALAPPS project will develop and validate an assessment instrument to specifically assess these dimensions of overweightness/obesity management apps.
OBJECTIVE
To reach a consensus among stakeholders on a comprehensive set of criteria to guide development of the EVALAPPS assessment instrument. A modified Delphi process was used in order to: 1) verify the robustness of the criteria identified through a literature review; 2) prioritize a set of the identified criteria.
METHODS
31 stakeholders were invited to participate in a 2 round Delphi process with an initial number of 114 criteria identified from the literature. In Round 1 participants rated criteria according to relevance (0 = “I suggest this criterion is excluded”, 5 = “This criterion is extremely relevant”). A criterion was accepted if a median value equal or greater than 4 and RIQR equal or less than 0.67 was reached. In Round 2 participants were asked about criteria discarded in round 1. The prioritization strategy was based on identifying those indicators categorized as Crucial in Round 1 according to: a) the importance attributed by participants (criteria with a mean value ≥ 4.00); and, b) the level of agreement (criteria scoring almost 4-5 by 80% of the participants).
RESULTS
The response rate was 84% in Round 1, 90% in Round 2. A total number of 107 criteria were accepted by consensus (94%), 105 in Round 1 and 2 in Round 2. After the prioritization strategy, 53 criteria were deemed Crucial. These related mainly to the Security and Privacy (24.5%) and Usability (17.0%) dimensions, followed by Health indicators: Activity data, Clinical Effectiveness and Reliability (9.4% each).
CONCLUSIONS
Results confirmed the robustness of the identified criteria, with those relating to Security and Privacy being deemed most relevant by stakeholders. Additionally, a specific set of criteria based on Health indicators was also prioritized (taken together, 20.7%).
CLINICALTRIAL
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.