Measuring Mental Effort for Creating Mobile Data Collection Applications

Abstract

To deal with drawbacks of paper-based data collection procedures, the QuestionSys approach empowers researchers with none or little programming knowledge to flexibly configure mobile data collection applications on demand. The mobile application approach of QuestionSys mainly pursues the goal to mitigate existing drawbacks of paper-based collection procedures in mHealth scenarios. Importantly, researchers shall be enabled to gather data in an efficient way. To evaluate the applicability of QuestionSys, several studies have been carried out to measure the efforts when using the framework in practice. In this work, the results of a study that investigated psychological insights on the required mental effort to configure the mobile applications are presented. Specifically, the mental effort for creating data collection instruments is validated in a study with N = 80 participants across two sessions. Thereby, participants were categorized into novices and experts based on prior knowledge on process modeling, which is a fundamental pillar of the developed approach. Each participant modeled 10 instruments during the course of the study, while concurrently several performance measures are assessed (e.g., time needed or errors). The results of these measures are then compared to the self-reported mental effort with respect to the tasks that had to be modeled. On one hand, the obtained results reveal a strong correlation between mental effort and performance measures. On the other, the self-reported mental effort decreased significantly over the course of the study, and therefore had a positive impact on measured performance metrics. Altogether, this study indicates that novices with no prior knowledge gain enough experience over the short amount of time to successfully model data collection instruments on their own. Therefore, QuestionSys is a helpful instrument to properly deal with large-scale data collection scenarios like clinical trials.

Towards a new era of mass data collection: Assessing pandemic surveillance technologies to preserve user privacy

“…(2019) Computers & Security Computer Science ● ○ Salo and Makkonen (2018) Communications of the Association for Information Systems Information Systems ○ Sang et al. (2017) ACM Transactions on Intelligent Systems and Technology Artificial Intelligence ○ ● Schobel et al. (2020) International Journal of Environmental Research and Public Health Public, Environmental & Occu.…”

“…(2019) ). In this respect, four types of data are distinguished ( Taylor (2017) ; Schobel et al., 2020 ) (see Table 2 ).…”

Supporting Medical Staff from Psycho-Oncology with Smart Mobile Devices: Insights into the Development Process and First Results

“…The models are executed within an engine that is capable of running on smart mobile devices [ 37 , 38 ]. A large-scale and long-running study showed the applicability of this approach [ 39 ] and measured mental effort when implementing such mobile data collection applications [ 40 ].…”

Establishing a Generic Geographic Information Collection Platform for Heterogeneous Data

“…Among these methods, field data collection is an essential means of gathering ground-truth spatial information [2]. Field data collection plays an important role in many geospatial applications, including crop yield estimation [3], hydrologic studies [4], mobile health [5], township land resources surveying [6], and so on. The methods of collecting geographic information in the field have undergone many developments.…”