Differential Effects of Web-Based and Paper-Based Administration of Questionnaire Research Instruments in Authentic Contexts-of-Use

Hardré, Patricia L.; Crowson, H. Michael; Xie, Kui

doi:10.2190/ec.42.1.e

Cited by 20 publications

(15 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Affect is also related to users' willingness to participate and to data quality (Hardré, Crowson, & Xie, 2010). People often respond to computers as entities with social identities or as extensions of the people behind or within digital systems (Dodge, 2005;Moon, 2000;Nass, Fogg, & Moon, 1996).…”

Section: Differential Effects By Administration Methodsmentioning

confidence: 99%

“…Of those published studies conducted in uncontrolled environments, most have not included any characteristics of user-chosen contexts-of-administration. For both paper and digital instruments, the context may be a public or social space, and conditions may include interacting with other people and engaging in other concurrent activities (Hardré, Crowson, & Xie, 2010). Among the range of potentially influential factors that surround research administration, context factors outside of researcher control may have a direct impact on participants during instrument completion.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires

Hardré

Crowson

Xie

2012

Educational and Psychological Measurement

Self Cite

View full text Add to dashboard Cite

Questionnaire instruments are frequently administered in digital formats, largely webbased, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263 university students were randomly assigned to one of two administration formats, web-based (WBA) or paper-based (PBA), to complete a set of questionnaires in an environment of their choice. Data collection included reporting context characteristics along three parameters: location, companions, and concurrent activities (including help-seeking). Outcomes of interest included location and conditions of user-chosen contexts, instrument performance, generative data quantity and quality, independence of completion, administrative efficiency, and participant affect. Participants did choose and allow distracters in their contexts-of-use, completing the questionnaires while engaged in multiple social and asocial concurrent activities. There were generally small but significant differences in instrument performance and user response characteristics by administration method and contexts-of-use. Participant comfort and data returned were both higher in PBA than WBA. Quantity return of generative data was higher in WBA while overall quality (completeness, coherence, correctness) of generative data was not significantly different. These findings present implications of administrative methods and contextual influences that inform measurement professionals' selection and design of administrative systems and conditions for research and evaluation data collection.

show abstract

Section: Differential Effects By Administration Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires

Hardré

Crowson

Xie

2012

Educational and Psychological Measurement

Self Cite

View full text Add to dashboard Cite

show abstract

“…For the second through fifth semesters of Study 2, we converted the paper survey to an electronic version and posted it onto SurveyMonkey™. We chose this approach since the reported difference between paper-pencil and online responses is minimal (Hardre, Crowson, and Xie 2010;Hardre et al 2007). We also converted to help ensure privacy, increase convenience, and boost the number of participants.…”

Section: Data Collectionmentioning

confidence: 99%

Development of the Indicators of Successful Inclusion Scale (ISIS): addressing ecological concerns

Brandes

McWhirter

Haring

et al. 2012

Teacher Development

View full text Add to dashboard Cite

The Indicators of Successful Inclusion Scale (ISIS) was developed to measure pre-service and practicing educators' beliefs regarding factors that contribute to educating students with disabilities in general education classrooms. The measure was designed to assess teachers' beliefs and attitudes related to inclusive education and to consider their possible utility for understanding teachers' inclusion-related intentions and behaviors. Specifically, the ISIS targets personal and ecological factors thought to influence intentional inclusive practice: beliefs related to the perceived benefits of inclusion, beliefs regarding administrative school support for the practice of inclusion. ISIS scale development, and exploratory and confirmatory factor analyses yielded discrete subscales addressing teachers' ecological beliefs. Analyses of internal consistency and test-retest reliability data suggest the ISIS functions in a reliable fashion. Our construct validation procedures yielded evidence supporting the ISIS as a measure of pre-service and practicing teacher beliefs pertaining to inclusive education. Implications for the use of ISIS toward encouraging inclusive practices and enhancing a culture of inclusion are discussed.

show abstract

“…Research on effects of survey modes (performed among older respondents, in other settings, and using other measures) comparing paper-based administration methods with online administrations methods has reported somewhat mixed findings (Carini et al, 2003). Hardré et al (2010) found that scores of respondents in a paper-based condition were slightly higher than the scores of those in a web-based condition, whereas the opposite was found in a study by Carini et al (2003). Carini et al (2003) has indicated that mode effects were generally small, and other studies (Hardré et al, 2007(Hardré et al, , 2010 found no effect of the administrative method on the reliability of the measures.…”

Section: Discussionmentioning

confidence: 71%

Effect of a school library on the reading attitude and reading behaviour in non-western migrant students

Kleijnen

Huysmans

Ligtvoet

et al. 2015

Journal of Librarianship and Information Science

View full text Add to dashboard Cite

Effect of a school library on the reading attitude and reading behaviour in non-western migrant students Kleijnen, E.; Huysmans, F.J.M.; Ligtvoet, R.; Elbers, E. Disclaimer/Complaints regulationsIf you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. AbstractThere is a lack of clarity as to the effects of school libraries on children with a nonWestern background in the Netherlands, an educationally disadvantaged group. Using a longitudinal design involving an experimental and a control school, the present study examined whether an integrated library facility in a Dutch primary school has an effect on the reading attitude and reading behaviour of non-Western migrant students (n = 140). The results showed no statistically significant effect on the degree in which students think reading is fun. On the other hand, over time, students attending the experimental school considered reading more useful than students visiting the control school. With regard to reading behaviour no statistically significant effect of the school library was found.However, the school library program was not implemented in the most optimal form, which may have affected the findings. Reading climate at home was found to be an important predictor of both reading attitude and reading behaviour, stressing the importance of parents as partners for school libraries when it comes to reading promotion.

show abstract

Differential Effects of Web-Based and Paper-Based Administration of Questionnaire Research Instruments in Authentic Contexts-of-Use

Cited by 20 publications

References 55 publications

Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires

Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires

Development of the Indicators of Successful Inclusion Scale (ISIS): addressing ecological concerns

Effect of a school library on the reading attitude and reading behaviour in non-western migrant students

Contact Info

Product

Resources

About