Lessons Learned from Applying Design Thinking in a NASA Rapid Design Study in Aeronautics

Abstract

In late 2015, NASA's Aeronautics Research Mission Directorate (ARMD) funded an experiment in rapid design and rapid teaming to explore new approaches to solving challenging design problems in aeronautics in an effort to cultivate and foster innovation. This report summarizes several lessons learned from the rapid design portion of the study. This effort entailed learning and applying design thinking, a human-centered design approach, to complete the conceptual design for an open-ended design challenge within six months.The design challenge focused on creating a capability to advance experimental testing of autonomous aeronautics systems, an area of great interest to NASA, the US government as a whole, and an entire ecosystem of users and developers around the globe. A team of nine civil servant researchers from three of NASA's aeronautics field centers with backgrounds in several disciplines was assembled and rapidly trained in design thinking under the guidance of the innovation and design firm IDEO. The design thinking process, while used extensively outside the aerospace industry, is less common and even counter to many practices within the aerospace industry. In this report, several contrasts between common aerospace research and development practices and design thinking are discussed, drawing upon the lessons learned from the NASA rapid design study.The lessons discussed included working towards a design solution without a set of detailed design requirements, which may not be practical or even feasible for management to ascertain for complex, challenging problems. This approach allowed for the possibility of redesigning the original problem statement to better meet the needs of the users. Another lesson learned was to approach problems holistically from the perspective of the needs of individuals that may be affected by advances in topic area instead of purely from a technological feasibility viewpoint. The interdisciplinary nature of the design team also provided valuable experience by allowing team members from different technological backgrounds to work side-by-side instead of dividing into smaller teams, as is frequently done in traditional multidisciplinary design. The team also learned how to work with qualitative data obtained primarily through the 70-plus interviews that were conducted over the course of this project, which was a sharp contrast to using quantitative data with regards to identifying, capturing, analyzing, storing, and recalling the data. When identifying potential interviewees who may have useful contributions to the design subject area, the team found great value in talking to non-traditional users and potential beneficiaries of autonomous aeronautics systems whose impact on the aeronautics autonomy ecosystem is growing swiftly. Finally, the team benefitted from using "sacrificial prototyping," which is a method of rapidly prototyping draft concepts and ideas with the intent of enabling potential users to provide significant feedback early in the design process. This contrasts the mo...

Trustworthy performance evaluations: The Performance Outcome Scoring Template (POS-T) for transparent assessments in real-world programs

“…This study set out to develop a scoring template that combines internal and external measures of performance by alignment of measurement scales which represent meaningful magnitudes of change. The resulting POS-T adheres to the principle of providing the stakeholders governing applied programs a means to report performance outcomes with convincing face-validity 37,43,44 . We exemplified application of POS-T in an evaluation of CO2 emission reduction amongst OECD member countries.…”

“…47,48 This approach aligns with the principles of design thinking 49 where the emphasis is placed on defining the problem to be solved through the needs of the stakeholders involved. 43,44 . In the following, the main features of the POS-T are discussed considering the CO2 emission example and directions are outlined for future research.…”

Designing the Design Process for Early Problem Discovery for a Complex Aeronautics Systems Challenge

“…The challenges here are complex and thus often improved via learning from others. A summary of lessons learned from a previous CAS rapid design innovation effort can also be found in McGowan, et al (2017).…”

Measuring Systems Engineering and Design Thinking Attitudes

“…Systems engineering organizations like governmental mission agencies and manufacturing corporations are exploring opportunities for applying design thinking principles in systems engineering projects (Souza and Barnhöfer 2015;Darrin and Devereux 2017;McGowan et al 2013;McGowan et al 2017). Short courses or accelerated project experiences where engineers can learn design thinking methods through a hands-on design process and reflection are common.…”