The Agreement between Parent-Reported and Directly Measured Child Language and Parenting Behaviors

Abstract

Parenting behaviors are commonly targeted in early interventions to improve children’s language development. Accurate measurement of both parenting behaviors and children’s language outcomes is thus crucial for sensitive assessment of intervention outcomes. To date, only a small number of studies have compared parent-reported and directly measured behaviors, and these have been hampered by small sample sizes and inaccurate statistical techniques, such as correlations. The Bland–Altman Method and Reduced Major Axis regression represent more reliable alternatives because they allow us to quantify fixed and proportional bias between measures. In this study, we draw on data from two Australian early childhood cohorts (N = 201 parents and slow-to-talk toddlers aged 24 months; and N = 218 parents and children aged 6–36 months experiencing social adversity) to (1) examine agreement and quantify bias between parent-reported and direct measures, and (2) to determine socio-demographic predictors of the differences between parent-reported and direct measures. Measures of child language and parenting behaviors were collected from parents and their children. Our findings support the utility of the Bland–Altman Method and Reduced Major Axis regression in comparing measurement methods. Results indicated stronger agreement between parent-reported and directly measured child language, and poorer agreement between measures of parenting behaviors. Child age was associated with difference scores for child language; however, the direction varied for each cohort. Parents who rated their child’s temperament as more difficult tended to report lower language scores on the parent questionnaire, compared to the directly measured scores. Older parents tended to report lower parenting responsiveness on the parent questionnaire, compared to directly measured scores. Finally, speaking a language other than English was associated with less responsive parenting behaviors on the videotaped observation compared to the parent questionnaire. Variation in patterns of agreement across the distribution of scores highlighted the importance of assessing agreement comprehensively, providing strong evidence that simple correlations are grossly insufficient for method comparisons. We discuss implications for researchers and clinicians, including guidance for measurement selection, and the potential to reduce financial and time-related expenses and improve data quality. Further research is required to determine whether findings described here are reflected in more representative populations.

Maternal intelligence quotient (IQ) predicts IQ and language in very preterm children at age 5 years

“…Limitations also include modest sample size (n = 122) and the fact that although the StimQ-Preschool was developed using the gold-standard HOME Inventory (Dreyer et al, 1996), cognitive stimulation was primarily assessed using parentreport. Future studies should complement the StimQ-Preschool with observational ratings from parent-child interaction tasks (see Bennetts, Mensah, Westrupp, Hackworth, & Reilly, 2016). This study also used a brief assessment of maternal intellectual ability.…”

Early Hearing Detection and Vocabulary of Children With Hearing Loss

“…13 This norm-referenced assessment has been extensively validated with typically developing children 14, 15 as well as those with a variety of different disabilities, 16, 17 including hearing loss. 18, 19 Families in which the language of the home was Spanish completed the Spanish version of this instrument.…”

Influence of age at seizure onset on the acquisition of neurodevelopmental skills in an SCN8A cohort

“…First, because our questionnaire was completed by parents or caregivers, there is a potential for respondent recall error. 25 However, to assess consistency of the questionnaire, we compared results from a similar survey taken by 51 of the same participants 1 year prior to the current questionnaire and found the data to be highly concordant between the 2 years (Table S7). Of note, we indirectly acquired information for the Denver II from parents/caregivers who were asked whether their child had acquired a set of skills (yes/no).…”

“…Despite these promising results, there are several limitations. First, because our questionnaire was completed by parents or caregivers, there is a potential for respondent recall error . However, to assess consistency of the questionnaire, we compared results from a similar survey taken by 51 of the same participants 1 year prior to the current questionnaire and found the data to be highly concordant between the 2 years (Table ).…”