Screenomics: A New Approach for Observing and Studying Individuals’ Digital Lives

Abstract

This study describes when and how adolescents engage with their fast-moving and dynamic digital environment as they go about their daily lives. We illustrate a new approach— screenomics—for capturing, visualizing, and analyzing screenomes, the record of individuals’ day-to-day digital experiences. Sample includes over 500,000 smartphone screenshots provided by four Latino/Hispanic youth, age 14 to 15 years, from low-income, racial/ethnic minority neighborhoods. Screenomes collected from smartphones for 1 to 3 months, as sequences of smartphone screenshots obtained every 5 seconds that the device is activated, are analyzed using computational machinery for processing images and text, machine learning algorithms, human labeling, and qualitative inquiry. Adolescents’ digital lives differ substantially across persons, days, hours, and minutes. Screenomes highlight the extent of switching among multiple applications, and how each adolescent is exposed to different content at different times for different durations—with apps, food-related content, and sentiment as illustrative examples. We propose that the screenome provides the fine granularity of data needed to study individuals’ digital lives, for testing existing theories about media use, and for generation of new theory about the interplay between digital media and development.

The impact of the digital revolution on human brain and behavior: where do we stand?

“…Overall, the current situation cannot distinguish in most cases between causal effects and pure correlation. Important studies have been started, 70,71 and the Adolescent Brain Cognitive Development Study (ABCD study) should be mentioned. It is orchestrated by the National Institutes of Health (NIH) and aims to explore the effect of environmental, social, genetic, and other biological factors affecting brain and cognitive development.…”

The sources and correlates of exposure to vaccine-related (mis)information online

“…In addition, mobile data is typically only available for a small share of tracking samples [14] . Future research should seek to fill in these gaps with more fine-grained data (e.g., [27] ). Third, we cannot measure exposure to information on mobile web browsers or within applications.…”

Are online behaviors damaging our in-person connections? Passive versus active social media use on romantic relationships

“…Future studies could replicate the findings from this study using objective measures of SMU. New technologies have emerged that allow researchers to objectively and passively collect smartphone data from participants (see Ram et al, 2020). This novel form of data collection may become the new norm within social media research.…”