What’s Creative About Sentences? A Computational Approach to Assessing Creativity in a Sentence Generation Task

Weinstein, Theresa; Majed, Simon; Meinel, Christoph; Benedek, Mathias

doi:10.1080/10400419.2022.2124777

“…While Coh-Metrix components (such as narrativity, syntactic simplicity, word concreteness, referential cohesion, and deep cohesion) predicted imagery and voice but not originality. Weinstein et al (2022) identified general word frequency, infrequency of word combinations, context-specific word uniqueness, syntax uniqueness, rhymes, and phonetic similarity as predictors of higher ratings for sentence creativity. Johnson et al (2022) compared different models of semantic diversity in explaining the human-rated creativity of short narratives.…”

Section: Limitations Future Directions and Conclusionmentioning

confidence: 95%

Measuring Creativity in Academic Writing: An Analysis of Essays in Advanced Placement Language and Composition

Bower,

Acar,

Kursuncu

2023

Preprint

0

View full text Add to dashboard Cite

The demand for a creative workforce has never been higher, yet schools struggle to teach and assess creativity among students efficiently. Compositions are an effective way to incorporate creativity across the curriculum; however, essays are time consuming to evaluate for quality or creativity. This study explored (a) if high creativity scores are related to high quality and sophistication in academic writing, and (b) if extant text-mining tools effectively identify quality, sophistication, and creativity in academic essays. Four teacher raters analyzed quality, sophistication, and creativity of 230 essays written by students aged 15–17 for Advanced Placement Language and Composition. We also used text-mining tools (e.g., semantic distance, Shannon's entropy, idea density) to score these essays. Teacher-rated creativity scores correlated with quality and sophistication scores, as well as with some of the text-mining tools, suggesting that these tools can capture quality and sophistication in addition to creativity. Implications for educational practice are discussed.

show abstract

“…While Coh-Metrix components (such as narrativity, syntactic simplicity, word concreteness, referential cohesion, and deep cohesion) predicted imagery and voice but not originality. Weinstein et al (2022) identified general word frequency, infrequency of word combinations, contextspecific word uniqueness, syntax uniqueness, rhymes, and phonetic similarity as predictors of higher ratings for sentence creativity. Johnson et al (2022) compared different models of semantic diversity in explaining the human-rated creativity of short narratives.…”

Section: Limitations Future Directions and Conclusionmentioning

confidence: 96%

Measuring Creativity in Academic Writing: An Analysis of Essays in Advanced Placement Language and Composition

Bower,

Acar,

Kursuncu

2023

Journal of Advanced Academics

View full text Add to dashboard Cite

The demand for a creative workforce has never been higher, yet schools struggle to teach and assess creativity among students efficiently. Compositions are an effective way to incorporate creativity across the curriculum; however, essays are time consuming to evaluate for quality or creativity. This study explored (a) if high creativity scores are related to high quality and sophistication in academic writing, and (b) if extant text-mining tools effectively identify quality, sophistication, and creativity in academic essays. Four teacher raters analyzed quality, sophistication, and creativity of 230 essays written by students aged 15–17 for Advanced Placement Language and Composition. We also used text-mining tools (e.g., semantic distance, Shannon's entropy, idea density) to score these essays. Teacher-rated creativity scores correlated with quality and sophistication scores, as well as with some of the text-mining tools, suggesting that these tools can capture quality and sophistication in addition to creativity. Implications for educational practice are discussed.

show abstract

Processes Involved in the Generation of Novel Ideas

Runco,

Bower

2023

The Quintessence of Basic and Clinical Research and Scientific Publishing

0

View full text Add to dashboard Cite

What’s Creative About Sentences? A Computational Approach to Assessing Creativity in a Sentence Generation Task

Cited by 6 publications

References 50 publications

Measuring Creativity in Academic Writing: An Analysis of Essays in Advanced Placement Language and Composition

Measuring Creativity in Academic Writing: An Analysis of Essays in Advanced Placement Language and Composition

Measuring Creativity in Academic Writing: An Analysis of Essays in Advanced Placement Language and Composition

Processes Involved in the Generation of Novel Ideas

Contact Info

Product

Resources

About