Developing an adaptive tool to select, plan, and scaffold oral assessment tasks for undergraduate courses

Abstract

The increased linguistic and cultural diversity of undergraduate classrooms at English language institutions has imposed additional pedagogical and assessment challenges on instructors, many of whom lack the knowledge necessary to design classroom activities and assessments that are fair to all students regardless of students' background and language abilities. The development of an adaptive instrument for instructors who do not specialize in English language learning represents an attempt to adjust instructional practices to meet this need. This paper reports on the development of an instrument that undergraduate instructors can use to plan their courses at universities where English is the language of instruction. The instrument's intended use is illustrated through an example that involves the planning of an interdisciplinary undergraduate course. To build this adaptive tool, a taxonomy that describes the relevant components of assessments that involve oral communication was developed and externally reviewed. The questions used in the instrument were then developed and piloted with a group of university undergraduate instructors; after which, the instrument was further refined. Although piloting revealed an increase in instructor awareness of how language abilities relate to assessment, further research is needed to determine the extent to which this tool affects instructor's classroom or assessment practices.

The influence of a group of Chinese EFL teachers’ beliefs on lesson planning with video-based synchronous computer-mediated communication: A qualitative multiple case study

“…Lesson planning builds connections among theory, curriculum, and teaching practice (Lee et al, 2009;Dunn et al, 2010). Given students' diverse needs and readiness, effective lesson planning is critical to address students' needs (Epp et al, 2015;Farrell, 2013). Well-developed lesson plans allow teachers to improve teaching efficiency, particularly for English language learners (Bartholomew et al, 2020).…”

Learning Analytics Dashboard Use in Online Courses: Why and How Instructors Interpret Discussion Data

“…Adding sensemaking process supports that encourage prediction of the ideal version of an analytic based on the course design and goals may also support sensemaking by ensuring that instructors have thought about what their students' behavior or language should look like before they begin interpreting the measured behaviors and language (Demmans Epp et al 2017a, b). Once the instructor has extracted meaningful information from the LAD, other features could be used to scaffold the planning of subsequent learning activities or assessments (as in Demmans Epp et al (2015) or Demmans Epp, Phirangee, Despres-Bedwward, and Wang (2017a)). These planning supports should further alleviate the sensemaking burden associated with analytics use for course adaption, whether that adaption is done at the micro or macro level.…”

Culturally responsive assessment in the psychology college classroom.

“…Verbal assessments, such as an oral exam or discussion, could provide an alternative means, though they may also be negatively impacted by proficiency with English and social anxiety (Mazur & Doran, 2010). There is a useful taxonomy for oral assessment intended for international students and English-language learners (Demmans Epp, Park, & Plumb, 2015). This taxonomy is in an interactive module where instructors can self-assess their courses and receive recommendations for how to be more inclusive in their assessment practices (available at http://www.cdemmansepp.com).…”