We showed a method to classify patients during the course of radiotherapy based on relative changes in EPID images and a hidden Markov model. Information obtained through this automated classification can complement the clinical information collected during treatment and help identify patients in need of a plan adaptation.