In this study, we applied different text-mining methods to the originality scoring of the Unusual Uses Test (UUT) and Just Suppose Test (JST) from the Torrance Tests of Creative Thinking (TTCT)–Verbal. Responses from 102 and 123 participants who completed Form A and Form B, respectively, were scored using three different text-mining methods. The validity of these scoring methods was tested against TTCT’s manual-based scoring and a subjective snapshot scoring method. Results indicated that text-mining systems are applicable to both UUT and JST items across both forms and students’ performance on those items can predict total originality and creativity scores across all six tasks in the TTCT-Verbal. Comparatively, the text-mining methods worked better for UUT than JST. Of the three text-mining models we tested, the Global Vectors for Word Representation (GLoVe) model produced the most reliable and valid scores. These findings indicate that creativity assessment can be done quickly and at a lower cost using text-mining approaches.

In creativity research, ideational flexibility, the ability to generate ideas by shifting between concepts, has long been the focus of investigation. However, psychometric work to develop measurement procedures for flexibility has generally lagged behind other creativity-relevant constructs such as fluency and originality. Here, we build from extant research to theoretically posit, and then empirically validate, a text-mining based method for measuring flexibility in verbal divergent thinking (DT) responses. The empirical validation of this method is accomplished in two studies. In the first study, we use the verbal form of the Torrance Test of Creative Thinking (TTCT) to demonstrate that our novel flexibility scoring method strongly and positively correlates with traditionally used TTCT flexibility scores. In the second study, we conduct a confirmatory factor analysis using the Alternate Uses Task to show reliability and construct validity of our text-mining based flexibility scoring. In addition, we also examine the relationship between personality facets and flexibility of ideas to provide criterion validity of our scoring methodology. Given the psychometric evidence presented here and the practicality of automated scores, we recommend adopting this new method which provides a less labor-intensive and less costly objective measurement of flexibility.

One of the best‐known and most frequently used measures of creative idea generation is the Torrance Test of Creative Thinking (TTCT). The TTCT Verbal, assessing verbal ideation, contains two forms created to be used interchangeably by researchers and practitioners. However, the parallel forms reliability of the two versions of the TTCT Verbal has not been examined for over 50 years. This study provides a long‐needed evaluation of the parallel forms reliability of the TTCT Verbal by correlating publisher generated and text‐mining‐based scores across the forms. The relatively weak relationship between the two forms, ranging between .21 and .40 for the overall TTCT Verbal and ranging between .03 and .33 for the individual TTCT Verbal tasks, suggests that caution should be exercised when researchers and practitioners use the two forms as equivalent measures of verbal creative idea generation.

No abstract

Background When students generate ideas, important inter‐individual variance exists both in the quantity and the quality of ideas they are able to produce (e.g., perfectionists who have few highly creative ideas or mass producers who produce a lot of uncreative ideas). In educational psychology research on creativity, the relation between the quantity and quality of ideas has not been well understood, limiting progress in this area. Aims We conceptualized Ideational Fluency as a phenomenon that requires participants to ‘survive’ to produce more ideas, and where dropping out of the ideational process was analogous to ‘dying’. Using this novel paradigm, we aimed to test the relations among Fluency (as a dependent variable); and creative Expertise, Originality and self‐reported Personality attributes (as independent variables). Sample and method Participants were drawn from three groups: those with demonstrated expertise in stage or screen acting (n = 104); undergraduates being trained in the same domain (n = 100), and adults with no acting training or experience (n = 92). Participants responded to the Alternate Uses Task; Non‐parametric and semi‐parametric survival models were fit to their Ideational Fluency; and average and maximum Originality scores, as well as self‐reported Personality attributes, were used as covariates. Results Across all participants, the Ideational Fluency survival function showed an S‐shape, but the Expertise grouping interacted with that pattern. The survival rate of professional actors decreased more rapidly during the first few ideas, but after the 5th idea, professional actors displayed a clear advantage in survival rate. Participants who were less original on average but who showed a high maximum Originality, as well as those participants who reported more Assertiveness and less Industriousness, also survived further into the Ideational process. Conclusions Contrary to our hypothesis, professional actors’ advantage in Fluency did not manifest in the survival model until after the 5th idea generated. A quantity‐quality trade‐off was observed with average Originality being associated with shorter survival, but that trade‐off was not observed with maximum Originality, which was associated with longer survival.