Current tools for recording chronic obstructive pulmonary disease (COPD) exacerbations are limited and often lack validity testing. We assessed the validity of an automated telephonic exacerbation assessment system (TEXAS) and compared its outcomes with existing tools.Over 12 months, 86 COPD patients (22.1% females; mean age 66.5 yrs; mean postbronchodilator forced expiratory volume in 1 s 53.4% predicted) were called once every 2 weeks by TEXAS to record changes in respiratory symptoms, unscheduled healthcare utilisation and use of respiratory medication. The responses to TEXAS were validated against exacerbation-related information collected by observations made by trained research assistants during home visits. No care assistance was provided in any way. Diagnostic test characteristics were estimated using commonly used definitions of exacerbation. Detection rates, compliance and patient preference were assessed, and compared with paper diary cards and medical record review.A total of 1,824 successful calls were recorded, of which 292 were verified by home visits (median four calls per patient, interquartile range three to five calls per patient). Independent of the exacerbation definition used, validity was high, with sensitivities and specificities between 66% and 98%. Detection rates and compliance differed extensively between the different tools, but were highest with TEXAS. Patient preference did not differ.TEXAS is a valid tool to assess COPD exacerbation rates in prospective clinical studies. Using different tools to record exacerbations strongly affects exacerbation occurrence rates.