Bursting Self-reports? Comparing Sampling Frequency Effects of Mobile Experience Sampling Method on Compliance, Attrition, and Sample Biases

Abstract

In-situ measurements, using the experience sampling method (ESM), can provide insight into behaviors and contextual factors by allowing individuals to self-report them via text or push messages on a smartphone close to the behavior of interest. However, more is needed to know about the data quality of these measures, particularly the impact of sampling frequency. This study aims to examine the effects of different sampling frequencies on compliance, sample biases, and reactivity of measures in the context of digital media use. In July 2021, a group of Dutch citizens (n=250) was randomly assigned to either a standard daily-intensive burst measure (DI-BM; seven surveys across the day) or hourly-intensive burst measure (HI-BM; 12 surveys over two hours per day) condition and surveyed across seven consecutive days, resulting in a total number of 16,135 surveys sent. Results indicate higher compliance in the standard ESM condition than in the burst ESM condition.