This systematic review sought to identify observational measures of parent–child interactions commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. Two separate searches of the same databases were conducted; firstly, to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Fourteen measures were identified from Search 1; a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 1327 retrieved papers that described the development and/or validation of the 14 measures identified in Search 1. Seventeen articles met the inclusion criteria, resulting in five observational measures for the final review. Data were extracted and synthesized using the COSMIN rating system to describe the methodological quality of each article alongside the overall quality rating of the psychometric property reported for each measure using the Terwee checklist. Measure reliability was categorized into four domains (internal consistency, test-re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that the majority of psychometric evidence related to children aged from birth the three with internal consistency, inter-rater reliability, and structural validity the most commonly reported properties, although this evidence was often weak. The findings suggest further validation of the included measures is required to establish acceptability for the whole target age group. Electronic supplementary material The online version of this article (10.1007/s10567-019-00275-3) contains supplementary material, which is available to authorized users.
Parenting programs are effective in the early intervention and treatment of children’s social, emotional and behavioural difficulties. However, inconsistency in the use of outcome measures limits the comparability of programs and creates challenges for practitioners seeking to monitor progress of families in their care. A systematic review was conducted to identify measures, appraise their psychometric properties and ease of implementation, with the overall objective of recommending a small battery of measures for use by researchers and practitioners. This article provides an overview of the most commonly used measures in experimental evaluations of parenting programs delivered to parents of children up to, and including, the age of 5 years (including antenatal programs). An in-depth appraisal of the psychometric properties and ease of implementation of parent outcome measures is also presented (findings in relation to child and dyadic outcome measures are presented elsewhere). Following a systematic search, 64 measures were identified as being used in three or more of 279 included evaluation studies. Data on the psychometric properties of 18 parent outcome measures were synthesised from 87 development and validation studies. Whilst it was not possible to identify a definitive battery of recommended measures, we are able to recommend specific measures that could be prioritised in further research and development and hold promise for those seeking to monitor the outcomes of parents and children in receipt of parenting programs. Electronic supplementary material The online version of this article (10.1007/s10567-019-00276-2) contains supplementary material, which is available to authorized users.
Many interventions that are delivered within public health services have little evidence of effect. Evaluating interventions that are being delivered as a part of usual practice offers opportunities to improve the evidence base of public health. However, such evaluation is challenging and requires the integration of research into system-wide practice. The Born in Bradford’s Better Start experimental birth cohort offers an opportunity to efficiently evaluate multiple complex community interventions to improve the health, wellbeing and development of children aged 0–3 years. Based on the learning from this programme, this paper offers a pragmatic and practical guide to researchers, public health commissioners and service providers to enable them to integrate research into their everyday practice, thus enabling relevant and robust evaluations within a complex and changing system. Using the principles of co-production the key challenges of integrating research and practice were identified, and appropriate strategies to overcome these, developed across five key stages: 1) Community and stakeholder engagement; 2) Intervention design; 3) Optimising routinely collected data; 4) Monitoring implementation; and 5) Evaluation. As a result of our learning we have developed comprehensive toolkits ( https://borninbradford.nhs.uk/what-we-do/pregnancy-early-years/toolkit/ ) including: an operational guide through the service design process; an implementation and monitoring guide; and an evaluation framework. The evaluation framework incorporates implementation evaluations to enable understanding of intervention performance in practice, and quasi experimental approaches to infer causal effects in a timely manner. We also offer strategies to harness routinely collected data to enhance the efficiency and affordability of evaluations that are directly relevant to policy and practice. These strategies and tools will help researchers, commissioners and service providers to work together to evaluate interventions delivered in real-life settings. More importantly, however, we hope that they will support the development of a connected system that empowers practitioners and commissioners to embed innovation and improvement into their own practice, thus enabling them to learn, evaluate and improve their own services.
This systematic review is one of the three which sought to identify measures commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. This review focuses specifically on measures of child social–emotional and behavioral outcomes. Two separate searches of the same databases were conducted; firstly to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Twenty-four measures were identified from Search 1: a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 21,329 articles that described the development and/or validation of the 24 measures identified in Search 1. Thirty articles met the inclusion criteria. resulting in 11 parent report questionnaires and three developmental assessment measures for review. Data were extracted and synthesized to describe the methodological quality of each article using the COSMIN checklist alongside the overall quality rating of the psychometric property reported for each measure. Measure reliability was categorized into four domains (internal consistency, test–re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that supporting evidence for included measures is weak. Further work is required to improve the evidence base for those measures designed to assess children’s social–emotional and behavioral development in this age group. PROSPERO Registration number: CRD42016039600. Electronic supplementary material The online version of this article (10.1007/s10567-019-00277-1) contains supplementary material, which is available to authorized users.
Background: Positive parent infant relationships are key to achieving long term child outcomes. Identifying parents who may need support is difficult because of a lack of robust assessment tools. Working in partnership with health services we piloted the Maternal Postnatal Attachment Scale (MPAS) in a deprived, multi-ethnic urban community in Bradford, UK. The pilot aimed to assess the clinical utility of MPAS to identify need for support: Was it administered to a representative group of women? Is MPAS valid for this population? Methods: Data were linked to a cohort study in the pilot area (Born in Bradford’s Better Start - BiBBS). Chi Square tests assessed sample representativeness (age, ethnicity, parity, English language, education, deprivation). Exploratory factor analysis explored MPAS’ validity. Results: 563 women in BiBBS were eligible, 210 (37%) completed MPAS. No differences were found between completers and non-completers, suggestive of a representative sample. In total, 336 women completed MPAS in the pilot. MPAS had ceiling effects and a satisfactory factor structure could not be identified, indicating poor psychometric properties Conclusions: Health visitors were successful in administering MPAS to a representative sample, but poor psychometric robustness indicates that MPAS is unsuitable for routine use in this setting. A gap for such a measure remains.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.