Vital signs are a set of commonly measured signals used internationally as a baseline in medicine and surgery and are one of the most accurate predictors of clinical and physiological deterioration. Despite the clear clinical importance of vital sign measurements, there is often missed or inadequate documentation of patient vital sign measurements. The development of unobtrusive, automated and continuous monitoring offers the potential to enhance the safety and quality of patient care. This thesis details a system that uses multiple modalities to capture data and data processing techniques to extract vital signal measurements and vital signal measurement abnormalities related to subject morbidities. This thesis focuses on the examination, testing and improvement upon a current visible light video processing technique intended to extract vital signal measurements, and expand it's use to thermal infrared video vital signal extraction. Three modalities were used to gather data from healthy adult subjects and older adult inhospital patients: thermal infrared cameras, visible light cameras and pressure sensitive mats. Subjects participated in several experimental procedures including video data capture of faces, hands and feet as well as in-bed pressure mat data capture. This data was subjected to several stages of data processing to extract vital signal measurements, which include pulse, respiration temperature and mobility measurements. Data segmentation using binary masks, level set method, and watershed method were used to identify regions of interest. An adaptive spatio-temporal video processing algorithm, the main thesis contribution, was used to extract vital signal measurements. The developed algorithm was assessed for its performance in vital signal estimation, as well its