This case study was designed to explore the strategies and actions that high performing schools with sustainable results employ at the district level in a rural part of Norway. The district subjected to the study is characterised by small municipalities and a scattered population, with a few small school administrative units, which might be a challenging context for sustainability and improvement. In response, the districts developed collaborative structures to increase collective learning capacity. The research design involved a collective case study, and it draws on data from interviews with school leaders at the municipal level and local school policy documents. The findings suggest that Norwegian school district actors can facilitate school improvement by shaping collaborating cultures, inter-organisational learning processes and educational infrastructures. Furthermore, the findings highlight the schools’ ability to recognise and value new knowledge from external sources, such as academic institutions and partner schools, assimilate novelties across boundaries and, eventually, utilise these for strategic or operational ends to enhance an organisation’s absorptive capacity. Finally, the findings indicate that superintendents can play important roles through boundary-spanning and gatekeeping activities.