Background: To quantify pharmacological effects on tremor in patients with essential tremor (ET) or Parkinson's Disease (PD), laboratory-grade accelerometers have previously been used. Over the last years, consumer products such as smartphones and smartwatches have been increasingly applied to measure tremor in an easy way. However, it is unknown how the technical performance of these consumer product accelerometers (CPAs) compares to laboratory-grade accelerometers (LGA). This study was performed to compare the technical performance of CPAs with LGA to measure tremor in patients with Parkinson's Disease (PD) and essential tremor (ET). Methods: In ten patients with PD and ten with ET, tremor peak frequency and corresponding amplitude were measured with 7 different CPAs (Apple iPhone 7, Apple iPod Touch 5, Apple watch 2, Huawei Nexus 6P, Huawei watch, mbientlabMetaWear (MW) watch, mbientlab MW clip) and compared to a LGA (Biometrics ACL300) in resting and extended arm position. Results: Both in PD and ET patients, the peak frequency of CPAs did not significantly differ from the LGA in terms of limits of agreement. For the amplitude at peak frequency, only the iPhone and MW watch performed comparable to the LGA in ET patients, while in PD patients all methods performed comparable except for the iPod Touch and Huawei Nexus. Amplitude was higher when measured with distally-located CPAs (Clip, iPhone, iPod) compared with proximally-located CPAs (all watches). The variability between subjects was higher than within subjects for frequency (25.1% vs. 13.4%) and amplitude measurement (331% vs. 53.6%). Resting arm position resulted in lower intra-individual variability for frequency and amplitude (13.4 and 53.5%) compared to extended arm position (17.8 and 58.1%).