Comprehensive evaluation of the use of technology in education – validation with a cohort of global open online learners

Lai, Jennifer W. M.; Nobile, John De; Bower, Matt; Breyer, Yvonne

doi:10.1007/s10639-022-10986-w

Cited by 19 publications

(9 citation statements)

References 86 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The evaluation framework offers a detailed description of the evolution methods that can be used in different evaluations. From the framework, it is clear that the evaluation methods can be used in any evaluation, but there are situations where one method is more appropriate than the other (Lai, De Nobile., Bower, & Breyer, 2022). For instance, qualitative evaluation methods are more appropriate in evaluations involving collecting and analyzing opinion data in social settings.…”

Section: Discussionmentioning

confidence: 99%

Contributions of the Most Significant Change (MSC) to Monitoring and Evaluation

Mwangi,

Abuya,

Syengo

2023

AfriJME

View full text Add to dashboard Cite

This paper discusses the contributions of the Most Significant Change (MSC), its benefits and challenges in the context of monitoring and evaluation. The inquiry used qualitative methods of data review. It was evident that one of the recognizable change systems of the monitoring and evaluation model is the Most Significant Change (MSC) analysis. The model was founded by Rick Davies in late 1993, and it is still helpful to date, particularly in social settings. Today, the majority of NGOs in developed and developing countries use the model to evaluate and monitor their projects through consideration of various stories as well as through the use of democratic and participatory involvement of others in the project. In using the model, project managers must gather stories, especially stories of substantial transformation among staff, volunteers, participants, and groups. The stories are then verified to evaluate the changes in place. The model works best in social settings, and it was first applied in Bangladesh by Christian workers and Rick Davies to solve humanitarian project challenges. In using the model, key elements and steps that should be considered include defining the change, deciding how to collect the stories and collecting the most significant change stories. The stories are then verified, and evaluation is done to ensure that the project meets all the stakeholder's needs and values. The model works best with qualitative methods and is mostly used when changes are uncertain. However, it is associated with unreliable data and bias since it involves personal stories. It is important that project managers use the model to promote the accountability and transparency of their projects. This study fully contributes to monitoring and evaluation since it highlights some of the ways that project teams can use in managing their stories and using such stories to promote their project scope, accountability and transparency.

show abstract

Section: Discussionmentioning

confidence: 99%

Contributions of the Most Significant Change (MSC) to Monitoring and Evaluation

Mwangi,

Abuya,

Syengo

2023

AfriJME

View full text Add to dashboard Cite

show abstract

“…To finalize the scale and confirm its dimensionality, reliability and validity, a large quantitative study has been undertaken (Lai, De Nobile, Bower & Breyer, in press). Principal Component Analysis and Confirmatory Factor Analysis were used to test the overall construct validity (Canivez et al, 2019; Wallace, 2004), resulting in a 28 item validated instrument (see Lai, De Nobile, Bower & Breyer, in press). Further studies could also focus on creating an instrument to be completed by stakeholders apart from students, for instance, educators, executives, technology developers.…”

Section: Discussionmentioning

confidence: 99%

What should we evaluate when we use technology in education?

Lai

Bower

Nobile

et al. 2022

Computer Assisted Learning

Self Cite

View full text Add to dashboard Cite

Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education.Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of evaluation instruments development in the educational technology field.

show abstract

“…With the adoption of a blended learning and teaching approach to higher education, teachers are required to enter a new ecology of teaching. This is characterised by the use of new resources in new contexts and settings which are reconfigured to create new ecologies of learning (Barron, 2006;Barnett & Jackson, 2019) and are highly mediated by the use of technology (Johnson et al, 2022;Lai et al, 2022). It may require teachers and students to invest considerable amounts of time to learn how to use new digital platforms and tools for different pedagogical and learning purposes.…”

Section: Ecologies Of Teaching and Learningmentioning

confidence: 99%