Linking TOEFL iBT® writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study

Fleckenstein, Johanna; Keller, Stefan; Krüger, Maleika; Tannenbaum, Richard J.; Köller, Olaf

doi:10.1016/j.asw.2019.100420

Cited by 34 publications

(33 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Further research is needed to show whether these findings are transferable to in-service teachers with reasonable experience in judging students' writing. Moreover, further studies could use assessment rubrics that teachers are more familiar with, such as the CEFR (Council of Europe, 2001; also see Fleckenstein et al, 2020). Second, the selection process of essays may have reduced the ecological validity of the experiment.…”

Section: Discussionmentioning

confidence: 99%

Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment

et al. 2020

Self Cite

View full text Add to dashboard Cite

The assessment of text quality is a transdisciplinary issue concerning the research areas of educational assessment, language technology, and classroom instruction. Text length has been found to strongly influence human judgment of text quality. The question of whether text length is a construct-relevant aspect of writing competence or a source of judgment bias has been discussed controversially. This paper used both a correlational and an experimental approach to investigate this question. Secondary analyses were performed on a large-scale dataset with highly trained raters, showing an effect of text length beyond language proficiency. Furthermore, an experimental study found that pre-service teachers tended to undervalue text length when compared to professional ratings. The findings are discussed with respect to the role of training and context in writing assessment.

show abstract

Section: Discussionmentioning

confidence: 99%

Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…Similar report showed that the average score was 22 of 30 maximum scores [4] [8]. Other reports of essay' scores of iBT had a commonsense that the scores of essays remained problems [9], [10] and the average was in high-intermediate (17-23 of 30), including Indonesian's test-takers of iBT [1].…”

Section: Introductionmentioning

confidence: 79%

Design-Based of FBFRP-Technique in Writing Computerized English Essays in the Light of CTL Method

Turmudi¹

2021

Proceedings of the 2nd Borobudur International Symposium on Humanities and Social Sciences, BIS-HSS 2020, 18 November 2020, Mag

View full text Add to dashboard Cite

Students and test takers of iBT faced difficult problem in solving how to write a full English Essay of different genres in 30 minutes with minimum 250 words. The designed technique facilitates students and test-takers how to write such essay in 30 minutes, but the result meets the standard ideal iBT TOEFL test model. The technique is called Forward-Back Forward Revising and Publishing (FBFRP) Technique. The designed is under the learning principles of CTL: critical creative and self-regulative thought. This study is 1) to provide a technique that can help students and test takers to develop their computerized-based English Essay effectively in 30 minutes, 2) to describe how the procedure of FBFRP technique work in writing computerized -based English Essay, 3) to shows readers how FBFRP technique was developed and validated. This is a research and development adopted by Borg and Gale (2003), Formative Evaluation taken by Tesmer (2013) self-evaluation, expert review, one-to-one, small group, and field test. The outcomes are 1) a technique that can help students and test takers called "FBFRP Technique, 2) a description or underlying principles of how FBFRP technique work in writing computerized-based English Essay, 3) the process of how FBFRP technique was validated. The product is applicable across disciplines in ELT or ESL context as an instructional tool, particularly for Academic writing course, and real test of internet-based TOEFL test takers.

show abstract

“…English is transformed as the most comfortable medium of instruction to communicate with each other in life, such as business, economy, technology, education, and social life. According to Keller (2013); Porsch and Köller (2010), in Fleckensteina et al (2020) convey English is the lingua franca of association of higher education, business, and science in the modern and globalized world. So English is a mandatory qualification for any individual who wants to achieve success in life, as mentioned earlier.…”

Section: Introductionmentioning

confidence: 99%

An Analysis on the Students' Error in Writing Report Text at Eight Grade Students of SMP N 6 Timang Gajah

Batubara¹,

Rahila²,

Rahmadani³

2021

JAS

View full text Add to dashboard Cite

This research aims to determine the students' errors in writing report text at eight grade SMP N 3 Timang Gajah students. The research was conduct using a qualitative approach with a descriptive design. The primary data source is the eighth-grade students and the teacher English at SMP N 3 Timang Gajah. The data collection instrument uses observation sheets, interview sheets, and the documentary (test) study and the researcher's data analysis using Miles and Huberman models, including data reduction, display, and verification. The percentage of grade VIII students' achievement in writing report text in the reference made is low, namely only reaching: general nouns 22.04%, at present tense 22.57%, on linking verbs 29.17% and action verbs are 26.21%. In conclusion, the students still error in writing report text at grade VIII students of SMP N 3 Timang Gajah. Therefore, they should have great motivation and interest in learning report text and get used to practicing it in everyday life.

show abstract

Linking TOEFL iBT® writing rubrics to CEFR levels: Cut scores and validity evidence from a standard setting study

Cited by 34 publications

References 9 publications

Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment

Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment

Design-Based of FBFRP-Technique in Writing Computerized English Essays in the Light of CTL Method

An Analysis on the Students' Error in Writing Report Text at Eight Grade Students of SMP N 6 Timang Gajah

Contact Info

Product

Resources

About