The Development and Evaluation of DEFT, a Web-Based Tool for Engineering Design Education

Moyne, Martina Margaret; Herman, Maxwell; Gajos, Krzysztof Z.; Walsh, Conor J.; Holland, Dónal

doi:10.1109/tlt.2018.2810197

Cited by 8 publications

(6 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We are also interested in adopting a visualization to condense all peer reviews into an understandable graphic (perhaps using aspectlevel opinion mining) to increase the information presented to an instructor for grading confidence. unique (15), outstand (11), creative( 9) hard(3), need(3), short(3) GM 10% unique (25), creative (19), structure (18), example (18) short (14), hard (7), need(5) GM 15% example (37), unique (37), impressive (32) hard (16), need (15), short(15) GM 20% impressive (60), example (57), unique (54) hard (21), need (21), short (21) SE 1% fantastic(3), engage(2), enjoy(2), useful(2), outstand(2) punctuation(1), incorrect(1), awkward(1), heavy(1), bor(1), stuck(1) SE 5% useful (15), outstand (10), enjoy (9), unique (9), fantastic( 9) need( 10), short (6), add(3), bor(3), heavy(3), hard(3) SE 10% useful (25), example (25), enjoy (18), outstand( 18) need( 21), short (16), hard(11) SE 15% example (52), useful (32), outstand (30) need (36), short (24), hard(15) SE 20% example(87), understand (40), useful (40) need (48), short…”

Section: Discussionmentioning

confidence: 99%

“…Our lexicon-based approach allows us to 1) collect sentiment to derive a fine-grained grade of peer-review text, 2) verify that grade with various metrics, and 3) suggest aspects important to the reviewers: candidates for addition to the review form. In this way, we can fulfill a "need for data collection tools that support teaching and learning" in engineering courses [10]. Our data-driven process addresses this need by providing the instructor with a better understanding of peer review and by increasing confidence in assigning a grade for complex assignments in large and massive open online courses (MOOCs).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment

Beasley¹,

Piegl²,

Rosen³

2021

Preprint

View full text Add to dashboard Cite

Accurately grading open-ended assignments in large or massive open online courses (MOOCs) is non-trivial. Peer review is a promising solution but can be unreliable due to few reviewers and an unevaluated review form. To date, no work has 1) leveraged sentiment analysis in the peer-review process to inform or validate grades or 2) utilized aspect extraction to craft a review form from what students actually communicated. Our work utilizes, rather than discards, student data from review form comments to deliver better information to the instructor. In this work, we detail the process by which we create our domaindependent lexicon and aspect-informed review form as well as our entire sentiment analysis algorithm which provides a fine-grained sentiment score from text alone. We end by analyzing validity and discussing conclusions from our corpus of over 6800 peer reviews from nine courses to understand the viability of sentiment in the classroom for increasing the information from and reliability of grading open-ended assignments in large courses.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment

Beasley¹,

Piegl²,

Rosen³

2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Observation and audio data confirm that the laboratory notebooks in this course accurately reflected teams’ design processes (Nefcy et al, 2013). Following other researchers (Arastoopour Irgens, 2021; Moyne et al, 2018; Snider et al, 2013), student teams’ notebooks were collected and analyzed to ascertain their epistemic practices.…”

Section: Methodological Frameworkmentioning

confidence: 99%

Connected epistemic practices in laboratory‐based engineering design projects for large‐course instruction

et al. 2022

View full text Add to dashboard Cite

In both K-12 and university settings, instructors and curriculum developers need to create learning experiences that provide students opportunities to engage in the disciplinary practices of science and engineering. However, instructional contexts pose challenges in developing such tasks. Using a framework focusing on conceptual and material epistemic practices and tools, we used a withinsubjects comparison to explore two different types of task designs, given realistic constraints posed by a largeenrollment university engineering laboratory course. We investigated students' modeling and experimental activity at scale using an innovative data analysis tool, Model Maps, looking for evidence of epistemic practices in student laboratory notebooks and in their post-project presentations. We compared inscriptions of 29 teams across three laboratory projects and found a greater number and diversity of model components in a virtual laboratory project than in two physical laboratory projects. While fitting into the same instructional "space," the virtual laboratory task, compared to the physical tasks, better afforded iteration. The iterative development engaged students in two important features of engineering

show abstract

“…According to [18] on the development of design evaluation and feedback tools, a web-based tool for education was used to support them for collection and report the data for learning, teaching and research. This web-based tool was developed due to the need of students, researchers and instructors to be used in projects design education.…”

Section: Related Workmentioning

confidence: 99%

A Survey of Monitoring and Evaluation Systems for Government Projects in Tanzania: A Case of Health Projects

Mleke¹,

Dida²

2020

IJIEEB

View full text Add to dashboard Cite

Monitoring and Evaluation (M&E) system are used across the world by organizations or governments to track progress, measure and evaluate outcomes of projects. Organizations can improve their performance, effectiveness and achieving results in project success by strengthening their monitoring and evaluation systems. Moreover, various studies reveal the need for information and communication technology systems in monitoring and evaluation activities because most of the government organizations do not employ computerized monitoring and evaluation systems and those having these systems lack a systematic early informing mechanism of the projects' progress. Currently, the Ministry of Health in Tanzania monitors and evaluates its projects manually, due to this, they face the risks and challenges during the implementation of projects because of a lack of having timely adoption of remedial action. Monitoring and evaluation staffs spent a lot of time in manual work, manual compilation of data, due to data being in separate systems, delay in submission of data, data is lost between primary registries to monthly summaries, from monthly to quarterly summaries, system does not contain all details about projects/program as well as budget information, no early alert information about the status of the project, poor information sharing among stakeholder. In this study, we collect representative data from three monitoring and evaluation staff, four ICT staff and five project members by using interviews, focus group discussion and document review. The result showed that the electronic monitoring and evaluation system will solve a presented challenge. Development of a web-based monitoring and evaluation system for the ministry of health projects will provides timely, accurate information, that for tracking the implementation progress of projects improved monitoring and evaluation.

show abstract

The Development and Evaluation of DEFT, a Web-Based Tool for Engineering Design Education

Cited by 8 publications

References 23 publications

Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment

Polarity in the Classroom: A Case Study Leveraging Peer Sentiment Toward Scalable Assessment

Connected epistemic practices in laboratory‐based engineering design projects for large‐course instruction

A Survey of Monitoring and Evaluation Systems for Government Projects in Tanzania: A Case of Health Projects

Contact Info

Product

Resources

About