Evaluating oral skills in an EST program: Native english-speaking scientists respond to Chinese scientists' english

Naerssen, Margaret van; Riggenbach, Heidi

doi:10.1016/0889-4906(87)90005-6

Cited by 1 publication

(2 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, individual differences were found even in the same rater group, and some doctor pairs had a coefficient of .44. Van Naerssen and Riggenbach (1987) also showed high correlations between domain and language specialists who were native speakers of English for professional tasks (r = .96) and for general proficiency questions (r = .99). However, domain specialists and nonnative language specialists had only a moderate correlation (r = .54) when grading for general proficiency questions.…”

Section: Differences Between Domain and Language Professionalsmentioning

confidence: 92%

“…Three quantitative studies (Elder 1993;Lumley 1998;van Naerssen and Riggenbach 1987) estimated correlation coefficients between domain and language rater groups, and they all showed that the two rater groups had moderate to high correlations for many dimensions, while some dimensions led to lower coefficients. In Elder (1993), where eight math/science teachers were compared with seven language specialists, the two rater groups demonstrated high correlations (r = .85 -.96) for linguistic dimensions (Intelligibility, Fluency, Accuracy, Comprehension, Interaction, and Overall Performance).…”

Section: Differences Between Domain and Language Professionalsmentioning

confidence: 99%

See 1 more Smart Citation

Systematic Research Synthesis on Rating in Esp Speaking Assessments

Hijikata

Min

2021

ESPEAP

View full text Add to dashboard Cite

Jacoby and McNamara (1998) insist that domain specialists (e.g., doctors) and language specialists (e.g., teachers) differ in their approaches to evaluating profession-specific communication tasks. However, due to the scarcity of studies examining speaking assessments for occupational purposes, the differences between the two rater groups have not yet been clearly revealed. In response to this gap in the literature, this systematic research synthesis study examines how the workplace speaking skill has been evaluated, focusing on rater groups and rating scales. The major findings are as follows. First, research on ESP speaking assessments tends to include more than one rater group such as domain specialists and language specialists. Second, while domain specialists and language specialists generally demonstrate high intergroup correlations, the rater group notably differs in terms of field-specific criteria. Third, compared with linguistic scales, field-specific criteria have not been developed. Based on these results, directions for future research are discussed.

show abstract

Section: Differences Between Domain and Language Professionalsmentioning

confidence: 92%