Evaluation of Empirical Design Studies and Metrics

Dinar, Mahmoud; Summers, Joshua D.; Shah, Jami J.; Park, Yong-Seok

doi:10.1007/978-3-319-33781-4_2

Cited by 8 publications

(3 citation statements)

References 101 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At the same time, design research is increasingly requested to include objective measures that characterize its inherent phenomena, e.g. (Dinar et al ., 2016) – this is particularly critical when human-related aspects are involved. In addition, scholars long for alleviating the burden of some human-intensive activities in design and design research and making these processes more automated – a case in point is protocol analysis (Jiang and Yen, 2009).…”

Section: Introductionmentioning

confidence: 99%

Review of the use of neurophysiological and biometric measures in experimental design research

Borgianni

Maccioni

2020

AIEDAM

View full text Add to dashboard Cite

AbstractDesign is inherently affected by human-related factors and it is of no surprise that the fine-tuning of instruments capable of measuring aspects of human behavior has attracted interest in the design field. The recalled instruments include a variety of devices that capture and quantitatively assess people's unintentional and unconscious reactions and that are generally referred as neurophysiological or biometric. The number of experimental applications of these instruments in design was extremely limited as of 2016, when Lohmeyer and Meboldt published a first report on relevant measures and their interpretation in design. In the last few years, the number of relevant publications has increased dramatically and this determines the opportunity to carry out a comprehensive review in the field. The reviewed contributions are analyzed and classified according to, among others, instruments used, the kind of stakeholders involved and the supported design research activities. The role of biometric measures with respect to traditional research methods is emphasized too. The discussed instruments can represent supports or substitutes for traditional approaches, as well as they are capable of exploring phenomena that could not be addressed hitherto. The intensity of research concerning experiments with biometric measurements is discussed too; a particular focus of the final discussion is the individuation of obstacles that prevent them from becoming commonplace in design research.

show abstract

Section: Introductionmentioning

confidence: 99%

Review of the use of neurophysiological and biometric measures in experimental design research

Borgianni

Maccioni

2020

AIEDAM

View full text Add to dashboard Cite

show abstract

“…SE&D is a broad area, with interest in both the behavior of individual human designers and also in large teams working for extended periods in multinational organizations. For those interested in the individual‐level questions (e.g., creativity) much of the methodological guidance from psychology applies with the caveat that novice–expert differences are of particular importance in how subjects are selected and the associated generalizability of findings . As a result, artifactual experiments may be most appropriate.…”

Section: Controlled Experiments and Their Application To Seandd Researchmentioning

confidence: 99%

Experiments in systems engineering and design research

Panchal

Szajnfarber

2017

Systems Engineering

View full text Add to dashboard Cite

Controlled experiments ranging from laboratory experiments to field experiments are becoming increasingly important within systems engineering and design (SE&D) research. Controlled experiments provide unique capabilities for testing hypotheses, and guiding the development of scientific theories, but their potential is not being fully exploited. As the systems engineering research community embraces different research methods commonly adopted in other domains, there is a need for understanding the role and appropriateness of those methods within the research process. While the design of experiments in SE&D research is not unique per se, we contend that aspects of representativeness in the SE&D context pose different experimental design challenges than do the problems typically studied by experimental social scientists. There is therefore a need to translate established practices to the SE&D context, and also belay widely held concerns about the value of experiments in SE&D research. To address this need, the goals of the paper are to discuss the potential role of controlled experiments in systems engineering and design research, to review the benefits and limitations of different types of experiments, and to highlight the key issues in validating experimental studies. The taxonomy and the discussion on validation build on the rich history in social and behavioral sciences, with specific adaptation to the SE&D context. The discussion is anchored in specific examples from the authors’ own research on open innovation in systems engineering.

show abstract

“…Depending on the purpose of the automation task, the assembling procedure can be fixed yielding exactly one solution, or capable of exploring various assembling strategies resulting in a solution space. In [15]and [16], building blocks for definition of conceptual design task are presented. However, the context of a task with regards to design process is not considered.…”

Section: Computational Design Task Definitionmentioning

confidence: 99%

A Federated Enterprise Architecture and MBSE Modeling Framework for Integrating Design Automation into a Global PLM Approach

Vosgien¹,

Rigger²,

Schwarz³

et al. 2017

IFIP Advances in Information and Communication Technology

View full text Add to dashboard Cite

PLM and Design Automation (DA) are two interdependent and necessary approaches to increase the performance and efficiency of product development processes. Often, DA systems' usability suffers due to a lack of integration in industrial business environments stemming from the independent consideration of PLM and DA. This article proposes a methodological and modeling framework for developing and deploying DA solutions within a global PLM approach. This framework supports the identification of DA potentials and the definition of the DA task building blocks to support DA task formalization by practitioners. The aim is to make the specification and development of DA solutions more efficient and aligned with the business requirements and with the existing digital environments. This framework combines the usage of two standardized modeling languages to make the captured knowledge re-usable across heterogeneous PLM and DA applications. An industrial case study demonstrating the applicability of the framework is introduced and discussed.

show abstract

Evaluation of Empirical Design Studies and Metrics

Cited by 8 publications

References 101 publications

Review of the use of neurophysiological and biometric measures in experimental design research

Review of the use of neurophysiological and biometric measures in experimental design research

Experiments in systems engineering and design research

A Federated Enterprise Architecture and MBSE Modeling Framework for Integrating Design Automation into a Global PLM Approach

Contact Info

Product

Resources

About