Robust and Efficient Driver Monitoring System Using a Synthesis of Facial Features and Biosignals

Abstract

Monitoring the driver's state of consciousness and fatigue is exclusively important to reduce the number of traffic accidents. We have proposed a collective data fusion method for checking driver safety levels by combining eye features and Heart rate Variability (HRV). Fatigue behavior was determined via facial image processing using Matlab as a tool. After detecting the face, the location of the eyes will be detected using the duration of eye closure, and the frequency of eye blinks. It is used as a distinctive characteristic to judge whether a driver is drowsy or not. General duration of closure is 0.15 to 0.25 seconds. Initially the HRV analysis was accomplished by acquiring Electrocardiogram (ECG) signal through non-intrusive ECG sensors wrapped on to the steering wheel followed by filtering noises and we have calculated pulse rate via peak detection using LabVIEW. Driver fatigue and heart attacks at road are the remarkable factors for a huge number of vehicle accidents. Driver Fitness and Monitoring is responsible for reviewing driving privileges of individuals and assessing their ability to safely operate motor vehicles. Some of the diseases or disabilities that may interfere with the safe operation of vehicles can be found in these categories: Vision (e.g. minimum correct vision, double vision, telescopic lenses), Hearing (e.g. vertigo, issues particular to commercial drivers), Cardiovascular diseases (e.g. heart disease, heart attack), Cerebrovascular Diseases (e.g. stroke), Metabolic diseases (e.g. diabetes, parathyroid, pituitary, adrenal), Musculoskeletal Disabilities (e.g. arms, legs, spine, paraplegia, quadraplegia), Psychiatric disorders (e.g. mental, emotional, personality, psychotic), effects of drugs (e.g. sedatives, tranquillizers, antidepressants, narcotics), effects of Alcohol (e.g. alcohol dependency) and aging Issues (e.g. loss of strength, slow reaction time, lack of attention, confusion, progressive dementia) 19 . Among these issues, fatigue and sudden heart attack are the major causes of accidents which cannot be controlled by driver even if he/she wants to do.The post-operative patients can develop complications once they are discharged from hospital. Hence the ECG of such patients needs to be monitored for some time after their treatment.