Teaching and learning in science disciplines are dependent on multimodal communication. Earlier research implies that students may be challenged when trying to interpret and use different semiotic resources. There have been calls for extensive frameworks that enable analysis of multimodal texts in science education. In this study, we combine analytical tools deriving from social semiotics, including systemic functional linguistics (SFL), where the ideational, interpersonal, and textual metafunctions are central. In regard to other modes than writing—and to analyse how textual resources are combined—we build on aspects highlighted in research on multimodality. The aim of this study is to uncover how such a framework can provide researchers and teachers with insights into the ways in which various aspects of the content in multimodal texts are communicated through different semiotic resources. Furthermore, we aim to explore how different text resources interact and, finally, how the students, or authors of teaching resources, position themselves in relation to the subject. Data consist of one student text and one teaching resource text, both comprising drawn and written elements in combination with symbols. Our analyses of the student text suggest that the proposed framework can provide insights into students’ content knowledge and, hence, how construction of multimodal texts may be a useful tool for formative assessment. When it comes to teaching resources, the framework may be a useful tool for teachers when choosing resources, particularly in relation to students’ possibilities of meaning making when engaging with such texts, but also, as a basis for classroom discussions.

No abstract

Teaching and learning in ecology depend on multimodality, involving semiotic resources such as visual representations, subject-specific symbols, and written and spoken language. Furthermore, the ecology field involves complex processes and relationships, presenting student challenges. However, more research has yet to investigate how students design multimodal texts to represent complex biological processes. For a holistic understanding of ecology, it is crucial to understand different complex processes, such as the matter cycle, energy flow, decomposition, and their relations. Therefore, this study aims to, through multimodal text analysis based on systemic functional linguistics (SFL), identify how secondary students collectively present and combine such processes and how they position themselves through their textual choices. Results indicate that representing biological processes comprises several challenges for students. One way in which this is shown is the unclear use and meaning of arrows. Thereto, the students include various aspects uncommon in the field of ecology, for example, symbols inspired by comic books, values, and the role of humans, thereby relating ecosystems to their interests and everyday life. Implications for teaching are discussed, for instance, the importance of supporting students in terms of scientific content and how to represent it, which can be conducted through text discussions.