Examining mixing methods in an evaluation of a smoking cessation program

Betzner, Anne; Lawrenz, Frances; Thao, Mao

doi:10.1016/j.evalprogplan.2015.06.004

Cited by 7 publications

(6 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Our mixed-methods design provided a more nuanced understanding [52,53] of the implementation successes and challenges of the mHealth system than could have been achieved through one method alone, with the qualitative findings being used to understand and corroborate the quantitative findings [28,29,54]. We enhanced the trustworthiness of our qualitative data through including one of the NGO supervisors and research participants [PH] as coauthor.…”

Section: Discussionmentioning

confidence: 99%

Using a mHealth system to recall and refer existing clients and refer community members with health concerns to primary healthcare facilities in South Africa: a feasibility study

Odendaal

Lewin

McKinstry

et al. 2020

Global Health Action

View full text Add to dashboard Cite

Section: Discussionmentioning

confidence: 99%

Using a mHealth system to recall and refer existing clients and refer community members with health concerns to primary healthcare facilities in South Africa: a feasibility study

Odendaal

Lewin

McKinstry

et al. 2020

Global Health Action

View full text Add to dashboard Cite

“…Lo mismo cabe decir de los procedimientos y fuentes de recogida de información, aspecto clave en muchos estudios evaluativos, que deben apoyarse en variables, informaciones, opiniones, etc., muy diversas en cuanto a su tipología, diversidad de implicados y posibilidades de recogida. Esta complejidad a la que se enfrenta habitualmente el evaluador, hace que la triangulación de métodos, técnicas, fuentes y procedimientos de recogida de información y la utilización combinada de distintas metodologías (mixing methods) adquiera una especial relevancia en la investigación evaluativa, como medio de fortalecimiento y validación de los diagnósticos y resultados (Betzner, Lawrenz & Thao, 2016;Makrakis & Kostoulas-Makrakis, 2016;Perassi, 2009;White, 2013).…”

Section: La Diversidad Y Flexibilidad Metodológicaunclassified

La investigación evaluativa en el siglo XXI: un instrumento para el desarrollo educativo y social cada vez más relevante

Escudero

2016

RELIEVE

View full text Add to dashboard Cite

Escudero, Tomás (2016). La investigación evaluativa en el Siglo XXI: Un instrumento para el desarrollo educativo y social cada vez más relevante. RELIEVE, 22 (1), art. 4. DOI: http://dx.doi.org/10.7203/relieve.22.1.8164 Autor de contacto / Corresponding author ResumenTras una amplia revisión de las recientes publicaciones alrededor del tema, se analiza y valora la actual situación de la investigación evaluativa, como instrumento estratégico para la toma de decisiones de desarrollo y mejora de la sociedad y de la calidad de vida de los ciudadanos, en ámbitos diversos como la educación, la sanidad, la economía, la cultura, la protección social, las políticas públicas, etc. Se describe y fundamenta la identidad científica de la investigación evaluativa actual, incidiendo en su carácter transdisciplinar, en el auge de la evaluación de organizaciones e instituciones, en su apoyo en metodologías diversas y en la importancia de las estrategias participativas. Se destaca también la utilidad y el uso apropiado de las evaluaciones como objetivo prioritario de este tipo de investigación, apoyándose siempre en principios y normas éticas y de calidad científica y los correspondientes estudios metaevaluativos. Palabras clave:Investigación evaluativa, Desarrollo social, Disciplina transversal, Metodologías diversas, Estrategias participativas, Utilidad y uso de la evaluación, Normas ético-científicas, Metaevaluación Fecha de recepción 21 Diciembre de 2015 Fecha de aprobación 22 de Marzo de 2016 Fecha de publicación 23 de Marzo de 2016 AbstractAfter a wide revision of the recent publications about the subject, the present situation of evaluation research is analysed as a strategic tool for the decision making of the development and improvement of society and citizens' quality of life in varied sectors such as education, health, economy, culture, social protection, public policies, etc. The scientific identity of the evaluation research is described and founded upon, stressing its transdisciplinary character, the rise of the evaluation of organizations and institutions, and the use of different methodologies and the importance of participative strategies. Also outlined is the utility and appropriate use of the evaluations as priority object of this kind of research, relying always on principles and ethical rules of scientific quality and on the corresponding meta-evaluative studies.

show abstract

“…Multiple, mixed-methods evaluations are used widely, particularly for programmes that involve complex interventions or a complex mix of interventions [12, 13]. Multiple, mixed-methods approaches have a number of advantages, including providing a more holistic and textured picture of a programme and its implementation [12, 14, 15], and having the potential to redress the inherent biases that any single method has [16, 17].…”

Section: Introductionmentioning

confidence: 99%

“…Multiple, mixed-methods approaches have a number of advantages, including providing a more holistic and textured picture of a programme and its implementation [12, 14, 15], and having the potential to redress the inherent biases that any single method has [16, 17]. They also allow the corroboration, or triangulation, of findings [11, 16, 18, 19].…”

Section: Introductionmentioning

confidence: 99%

Multiple and mixed methods in formative evaluation: Is more better? Reflections from a South African study

Odendaal

Atkins

Lewin

2016

BMC Med Res Methodol

View full text Add to dashboard Cite

BackgroundFormative programme evaluations assess intervention implementation processes, and are seen widely as a way of unlocking the ‘black box’ of any programme in order to explore and understand why a programme functions as it does. However, few critical assessments of the methods used in such evaluations are available, and there are especially few that reflect on how well the evaluation achieved its objectives. This paper describes a formative evaluation of a community-based lay health worker programme for TB and HIV/AIDS clients across three low-income communities in South Africa. It assesses each of the methods used in relation to the evaluation objectives, and offers suggestions on ways of optimising the use of multiple, mixed-methods within formative evaluations of complex health system interventions.MethodsThe evaluation’s qualitative methods comprised interviews, focus groups, observations and diary keeping. Quantitative methods included a time-and-motion study of the lay health workers’ scope of practice and a client survey. The authors conceptualised and conducted the evaluation, and through iterative discussions, assessed the methods used and their results.ResultsOverall, the evaluation highlighted programme issues and insights beyond the reach of traditional single methods evaluations. The strengths of the multiple, mixed-methods in this evaluation included a detailed description and nuanced understanding of the programme and its implementation, and triangulation of the perspectives and experiences of clients, lay health workers, and programme managers. However, the use of multiple methods needs to be carefully planned and implemented as this approach can overstretch the logistic and analytic resources of an evaluation.ConclusionsFor complex interventions, formative evaluation designs including multiple qualitative and quantitative methods hold distinct advantages over single method evaluations. However, their value is not in the number of methods used, but in how each method matches the evaluation questions and the scientific integrity with which the methods are selected and implemented.

show abstract

Examining mixing methods in an evaluation of a smoking cessation program

Cited by 7 publications

References 25 publications

Using a mHealth system to recall and refer existing clients and refer community members with health concerns to primary healthcare facilities in South Africa: a feasibility study

Using a mHealth system to recall and refer existing clients and refer community members with health concerns to primary healthcare facilities in South Africa: a feasibility study

La investigación evaluativa en el siglo XXI: un instrumento para el desarrollo educativo y social cada vez más relevante

Multiple and mixed methods in formative evaluation: Is more better? Reflections from a South African study

Contact Info

Product

Resources

About