The Assessment of Driver’s Arousal States from the Classification of Eye-Blink Patterns

Detecting driver drowsiness using feature-level fusion and user-specific classification

“…Previous methods (Adachi et al, 2008;Bergasa et al, 2006;Bhowmick & Chidanand Kumar, 2009;Eriksson & Papanikotopoulos, 1997;Flores & Armingol, 2010;Ince & Yang, 2009;Jimenez-Pinto & Torres-Torriti, 2009;Jo et al, 2010Jo et al, , 2011Kurylyak et al, 2012;Li, 2008;Minkov et al, 2012;Noguchi et al, 2009;Orazio et al, 2007;Panning et al, 2011;Parmar, 2002;Sukno et al, 2009;Tsuchida et al, 2010;Uliyar & Ukil, 2012;Vural et al, 2007;Wang et al, 2009;Wu & Trivedi, 2007;Yunq et al, 2009) applied a fixed threshold (T F ) to all drivers. For example, if the distance between upper and lower eyelids is larger than some preset value (typically the result of training the system on a database of different subjects' eye images) the eye is classified as open.…”

“…In response to this mounting problem, methods for detecting driver drowsiness have been intensively studied in the automotive field (Adachi et al, 2008;Bergasa, Nuevo, Sotelo, Barea, & Lopez, 2006;Bhowmick & Chidanand Kumar, 2009;Damousis & Tzovaras, 2008;Dong, Hu, Uchimura, & Murayama, 2011;Eriksson & Papanikotopoulos, 1997;Ersal, Fuller, Tsimhoni, Stein, & Fathy, 2010;Flores & Armingol, 2010;Ince & Yang, 2009;Jimenez-Pinto & Torres-Torriti, 2009;Jo et al, 2010;Kawato & Ohya, 2000;Kircher, Uddman, & Sandin, 2002;Kurylyak, Lamonaca, & Mirabelli, 2012;Li, 2008;Liu, Hosking, & Lenn, 2009;Minkov, Zafeiriou, & Pantic, 2012;Murphy-Chutorian, Doshi, & Trivedi, 2007;Noguchi, Shimada, Ohsuga, Kamakura, & Inoue, 2009;Orazio, Leo, Guaragnella, & Distante, 2007;Panning, Al-Hamadi, & Michaelis, 2011;Parmar, 2002;Patel, Lal, Kavanagh, & Rossiter, 2011;Rongben, Lie, Bingliang, & Lisheng, 2004;Saradadevi & Bajaj, 2008;Shuyan & Gangtie, 2009;Sukno, Pavani, Butakoffand, & Frangi, 2009;Torkkola, Massey, & Wood, 2004;Tran, Craig, Wijesuriya, & Nguyen, 2010;Tsuchida, Bhuiyan, & Oguri, 2010;Uliyar & Ukil, 2012;Vural et al, 2007;Wang, Ding, Fang, & Liu, 2009;…”

“…Prior work on such algorithms can be categorized into three methods: texture-based methods (Bergasa et al, 2006;Eriksson & Papanikotopoulos, 1997;Flores & Armingol, 2010;Jo et al, 2010Jo et al, , 2011Kurylyak et al, 2012;Li, 2008;Minkov et al, 2012;Orazio et al, 2007;Panning et al, 2011;Parmar, 2002;Uliyar & Ukil, 2012;Wu & Trivedi, 2007), shape-based methods (Adachi et al, 2008;Ince & Yang, 2009;Noguchi et al, 2009;Sukno et al, 2009;Tsuchida et al, 2010;Wang et al, 2009), and combined texture-shape methods (Bhowmick & Chidanand Kumar, 2009;Yunq et al, 2009). Texture-based methods extract texture features for eye state classification using various feature extraction methods.…”

“…Among the visual features used by these methods are eye state information (Adachi et al, 2008;Bergasa et al, 2006;Bhowmick & Chidanand Kumar, 2009;Eriksson & Papanikotopoulos, 1997;Flores & Armingol, 2010;Ince & Yang, 2009;Jo et al, 2010Jo et al, , 2011Kurylyak et al, 2012;Li, 2008;Minkov et al, 2012;Noguchi et al, 2009;Orazio et al, 2007;Panning et al, 2011;Parmar, 2002;Sukno et al, 2009;Tsuchida et al, 2010;Uliyar & Ukil, 2012;Wang et al, 2009;Wu & Trivedi, 2007;Yunq et al, 2009), head movement (Kawato & Ohya, 2000;Murphy-Chutorian et al, 2007), yawning (Rongben et al, 2004;Saradadevi & Bajaj, 2008) and facial expression (Jimenez-Pinto & Torres-Torriti, 2009;Vural et al, 2007). Methods using eye state to measure driver drowsiness have generally done so by calculating values such as the percentage of eye closure (PERCLOS) Wierwille, Ellsworth, Wreggit, Fairbanks, & Kim, 1994, eye closure duration (ECD), and the frequency of eye closure (FEC) Orazio et al, 2007.…”

“…Wang et al (2009), Sukno et al (2009), and Noguchi et al (2009 extracted eye contours using an active shape model (ASM) and measured eyelid distance using landmarks in both eyes. Adachi et al (2008) carried out a similar measurement, but used two search windows to detect the eyelids.…”