No abstract

This paper describes the development of a comprehensive assessment instrument to examine the multiple outcomes of entrepreneurship education for engineering students. It is targeted at senior-level students enrolled in capstone engineering design courses and is part of a larger study intended to clarify the relationship between faculty beliefs and practices, program characteristics, and student outcomes. The assessment draws on survey items used within the investigators' own engineering and entrepreneurship programs as well as others identified in the literature. Items fall into six categories including: 1) attitudes, 2) behaviors, 3) knowledge and skills, 4) self-efficacy, 5)perceptions of programs and faculty, and 6) demographic data. The paper provides an overview of the assessment instruments that were considered by the research team and the methodology used to create the final student survey. It discusses challenges encountered during development and administration including identifying validated assessments in the field, selecting response scales, survey length, and student and faculty participation. Preliminary results from year one of data collection across multiple institutions are discussed.

Reliability is a fundamental concept of test construction. The most common measure of reliability, coefficient alpha, is frequently used without an understanding of its behavior. This article contributes to the understanding of test reliability by demonstrating that questions which lower reliability are inconsistent with the bulk of the test, being prone to test-taking tricks and guessing. These qualitative characteristics, obtained from focus groups, provide possible causes of lower reliability such as poorly written questions (e.g., the correct answer looks different from the incorrect answers), questions where students must guess (e.g., the topic is too advanced), and questions where recalling a definition is crucial. Quantitative findings confirm that questions lower reliability when students who answer correctly have lower overall scores than students who answer incorrectly. This phenomenon is quantified by the "gap" between these students' overall scores, which is shown to be highly correlated with other item metrics. An increasing number of concept inventory tests are being developed to assess student learning in engineering. Scores and student comments from the Statistics Concept Inventory are used to make these judgments.

Most research about women in engineering focuses on reasons for their under-representation. In contrast, we capitalized on an opportunity to study success: the School of Industrial Engineering at the University of Oklahoma had organically achieved parity of the sexes at the undergraduate level. To investigate this success, we adopted an ethnographic perspective, interviewing 185 students who represented four fields and four institutions as well as 12 faculty in Industrial Engineering at the University of Oklahoma. These data pointed to a combination of aspects of the discipline and the department culture as explanatory variables. Emerging from the data was a third explanatory variable: a high number of students, disproportionately many women, who relocated into Industrial Engineering from another major, underscoring the impact of broad recruiting activities. This paper emphasizes ideas that other departments can consider adapting to their own efforts to increase diversity.