The purpose of this study is to develop a framework that can identify critical human factors (HFs) that can generate human errors and, consequently, accidents in autonomous driving level 3 situations. Although much emphasis has been placed on developing hardware and software components for self-driving cars, interactions between a human driver and an autonomous car have not been examined. Because user acceptance and trust are substantial for the further and sustainable development of autonomous driving technology, considering factors that will influence user satisfaction is crucial. As autonomous driving is a new field of research, the literature review in other established fields was performed to draw out these probable HFs. Herein, interrelationship matrices were deployed to identify critical HFs and analyze the associations between these HFs and their impact on performance. Age, focus, multitasking capabilities, intelligence, and learning speed are selected as the most critical HFs in autonomous driving technology. Considering these factors in designing interactions between drivers and automated driving systems will enhance users' acceptance of the technology and its sustainability by securing good usability and user experiences.