Physical activity and cardiovascular disease (CVD) are intimately linked. Low levels of physical activity increase the risk of CVDs, including myocardial infarction and stroke. Conversely, when CVD develops, it often reduces the ability to be physically active. Despite these largely understood relationships, the objective measurement of physical activity is rarely performed in routine healthcare. The ability to use sensor-based approaches to accurately measure aspects of physical activity has the potential to improve many aspects of cardiovascular healthcare across the spectrum of healthcare, from prediction, prevention, diagnosis, and treatment to disease monitoring. This review discusses the potential of sensor-based measurement of physical activity to augment current cardiovascular healthcare. We highlight many factors that should be considered to maximise the benefit and reduce the risks of such an approach. Because the widespread use of such devices in society is already a reality, it is important that scientists, clinicians, and healthcare providers are aware of these considerations.