Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties. The ability to lip read enables a person with a hearing impairment to communicate with others and to engage in social activities, which otherwise would be difficult. Recent advances in the fields of computer vision, pattern recognition, and signal processing has led to a growing interest in automating this challenging task of lip reading. Indeed, automating the human ability to lip read, a process referred to as visual speech recognition, could open the door for other novel applications. This thesis investigates various issues faced by an automated lipreading system and proposes a novel "visual words" based approach to automatic lip reading. The proposed approach includes a novel automatic face localisation scheme and iii This work is dedicated to my lovely daughters Talah and Lujain, whose age is the same as this work, who learnt how to walk and talk far away from me, and without having the chance to read their lips.
iv
ACKNOWLEDGMENT Allah the most gracious and mercifulWho gave me the energy, health, nerves and provided me with all the people I am dedicating this hard work, which took me to spend a lot of determination and time until it came to light.