Organization of ideas in writing: what are raters sensitive to?

Abstract

Whether foreign language writing is rated using analytic rating scales or holistically, the organization of ideas is invariably one of the aspects assessed. However, it is unclear what raters are sensitive to when rating writing for organization. Which do they value more highly, the physical aspects of organization, such as paragraphing and the existence of organization markers, or deeper textual aspects, such as the coherent flow of ideas? This study investigates whether raters of timed essays value paragraphing, cohesive devices or coherence more when assigning a score for organization. The current study used multiple regression to ascertain what raters of the writing section of an in-house proficiency test were sensitive to when rating writing for organization using an analytic rating scale. The number of paragraphs, number of cohesive devices and coherence within 116 timed essays were evaluated and it was found that raters seem to value the physical aspects of organization more than the deeper textual aspects. Specifically, the number of paragraphs and the number of cohesive devices predicted differences in scores assigned for organization. In addition, the scores assigned for content were significantly predictive of scores for organization.

The Effect of Mindful Learning on Students’ Writing Competency

“…Students in experimental group showed a better content organization. In writing, a good content organization will make a good flow writing so that readers will more easily grasp the message (Ruegg & Sugiyama, 2013;Tosuncuoğlu, 2018).…”

Spelling Analysis, Effective Sentences and Paragraphs in Student Scientific Papers Applied Bachelor of Bali State Polytechnic

“…Researchers from this study confirmed the importance of its effects in attracting readers ' attention and interest. They train students to pay attention to their writing with introductory sentences supported by explanatory sentences and end with a cover [8].…”

Teacher Beliefs about Students’ Use of Cohesion in Writing: What Does the Textual Evidence Reveal?

“…The researcher was able to elicit from the participants that engagement with discussing a novel was 'more "substantial" than simply answering grammar questions '. Erdosy (2004) in Ruegg and Sugiyama (2013) applied think-aloud protocols to compare the assessment performance of four raters on a TOEFL exam. Similarly, MacIntyre 2007in Ruegg and Sugiyama (2013 p.3)conducted think-aloud protocols to find out if the grading scale that was based on an analytic framework proved reliable in assessing writing.…”