A Randomized Field Experiment Using Self-Reflection on School Behavior to Help Students in Secondary School Reach Their Performance Potential

Abstract

Recent policy reports documented that a growing group of students in secondary education could perform better given their expected performance. Studies showed that school performance is related to a range of social-emotional factors, including self-awareness, self-management, social awareness, and responsible decision making. However, experimental studies in schools on the relation between these factors and school performance are scarce, and results are mixed. This study used a randomized field experiment to examine whether self-reflection on school behavior of underperforming secondary school students affected their school performance [grade point average (GPA)], school engagement, and self-concept. The sample comprised 337 ninth-grade students (M = 15.74 years old; SD = 0.58) from 18 secondary schools in Netherlands. The intervention was designed in co-creation with teachers, to be as close to school practice as possible. Underperformance was measured using achievement test scores from both primary and secondary school, supplemented with teacher and parental assessments. Different model specifications were estimated to perform the analyses and test for robustness of findings. The results showed that, for treatment compliance, students with higher school motivation were approximately 29% more likely to comply. Students who reported higher levels of self-concept of school tasks were 17% less likely to comply. No significant effects of the treatment were observed on students' GPA, school motivation, hours spent on homework, or self-concept of school tasks. The treatment showed a negative effect on self-concept of leadership skills.

The Effects of Group differentiation by students’ learning strategies

“…We only find an effect of the intervention on student performance once we control for the teacher. This implies that the teacher plays a big role in the effectiveness of the intervention, and that differences between teachers are large (similar to what was found in Feron &Schils, 2020, andwhat is emphasized in Hulleman &Cordray, 2009). One potential explanation for this is that there might be a large difference in the perception of teachers in their competence level of being able to use differentiation in the classroom.…”

Not just words! Effects of a light-touch randomized encouragement intervention on students’ exam grades, self-efficacy, motivation, and test anxiety

“…Programs introduced in education are particularly prone to a negative correlation between sample size and effect size [32]. Therefore, well-executed largescale studies that employ an experimental design and impact students' achievement via their noncognitive skills often report limited or no findings [33,34]. This suggests that small case studies are insufficient to determine a particular educational program's scientific validity and practical utility.…”

Easing the transition: do Talent Lessons and Talent Talks support students’ self-regulated learning skills in the transition from primary to secondary education?

“…This study thus fulfills an important role in empirically validating already existing practical interventions that are thought to be useful, a method that is gaining popularity (cf. Feron and Schils, 2020).…”