Whereas situational judgment tests (SJTs) have traditionally been conceptualized as low-fidelity simulations with an emphasis on contextualized situation descriptions and context-dependent knowledge, a recent perspective views SJTs as measures of more general domain (context-independent) knowledge. In the current research, we contrasted these 2 perspectives in 3 studies by removing the situation descriptions (i.e., item stems) from SJTs. Across studies, the traditional contextualized SJT perspective was not supported for between 43% and 71% of the items because it did not make a significant difference whether the situation description was included or not for these items. These results were replicated across construct domains, samples, and response instructions. However, there was initial evidence that judgment in SJTs was more situational when (a) items measured job knowledge and skills and (b) response options denoted context-specific rules of action. Verbal protocol analyses confirmed that high scorers on SJTs without situation descriptions relied upon general rules about the effectiveness of the responses. Implications for SJT theory, research, and design are discussed.
a b s t r a c tThis study investigated the relations between eight characteristics of teaching and students' academic emotions (enjoyment, pride, anxiety, anger, helplessness and boredom) across four academic domains (mathematics, physics, German, and English). 121 students (50% female; 8th and 11th graders) were asked about their perceptions of teaching characteristics and their academic emotions using the experience sampling method (real-time approach) for a period of 10 school days, with intraindividual analyses conducted using a multilevel approach. Multilevel exploratory factor analysis revealed that the eight teaching characteristics (understandability, illustration, enthusiasm, fostering attention, lack of clarity, difficulty, pace, level of expectation) represented two factors, labeled supportive presentation style (e.g., comprising understandability) and excessive lesson demands (e.g., comprising difficulty). In line with our hypothesis, we found clear relations on the intraindividual level between the two factors of teaching characteristics and students' academic emotions in the classroom (e.g., supportive presentation style positively related to students' enjoyment and negatively related to their boredom). Further, and supporting the universality assumption of teaching characteristics/academic emotions relations, the strength of relations between the two factors of teaching characteristics and academic emotions was very similar across the four academic domains. Implications for future research and educational practice are discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.