No abstract

We evaluate the effects of participation in the Swedish version of the Science and Technology for Children Program on content and process skills in sciences, in grade 9. The Swedish version, called Natural Sciences and Technology for All (NTA), is predominantly employed in grades 1–6. Our outcome measures are scores and grades on nationwide standardised tests, and course grades, in biology, chemistry and physics, for the years 2009 and 2010. A nationally representative random sample of almost 16,000 test‐taking students is coupled with multi‐level information about the NTA, and background factors. Non‐random selection into the programme is addressed by propensity score analysis. The matched sample has almost maximum common support and is well behaved in terms of propensity scores. Accounting for selection is shown to be very important. We find significantly positive effects on national test scores (effect size 0.24) and national test grades for physics, but not for biology and chemistry. With respect to course grades, we find no significant effects at all. We consider explanations for the differences in the estimated effects across science subjects and between types of outcome variables, i.e. national standardised tests versus course grades.

This guide accompanies the following article: Mellander, E. & Svärdh, J. 2018 Inquiry‐based learning put to the test: Medium‐term effects of a science and technology for children programme. Review of Education, https://doi.org/10.1002/rev3.3109

No abstract

In Sweden, there have been multiple large scale interventions to support compulsory school teachers generally and within specific subjects. Due to the costs associated with such interventions it is critical that interim evaluation measures exist which can indicate potential success. Additionally, evaluation measures which can measure the actual impact of interventions relative to their intended aim are also needed as validation tools. The Swedish regional 'Tekniklyftet' or 'Boost of Technology' project which ran from 2011 to 2013 is presented here as a case study exploring evaluation measures for educational interventions in technology education. Three different evaluation approaches were used as measures of the intended outcomes of the intervention. These included (1) analysing the preconditions which exist in schools for teachers of Technology, (2) analysing the use of local long term technology education planning documents (school work plans) developed during the intervention, and (3) analysing the potential change over time in student performance in Technology based on national grades at the end of compulsory school. The findings gained from each approach indicate that the Boost of Technology project was a success. However, there were shortcomings associated with each approach. They are therefore discussed in the Swedish context with the intention to support future international stakeholders in the evaluation of interventions aspiring to develop technology education.