Objective: The aim of this study was to measure the association of working from home (WFH) with work productivity loss due to caregiving responsibilities or health problems during the COVID-19 pandemic. Methods: We conducted an online survey of family/friend caregivers (n = 150 WFH/75 non-WFH) and patients (n = 95/91) who worked during the past 7 days in May and July 2020, respectively. Absenteeism and presenteeism were measured using the Valuation of Lost Productivity questionnaire. Results: Working from home was associated with higher odds of absenteeism (odds ratio, 2.53; 95% confidence interval, 1.11 to 5.77) and presenteeism (2.79; 1.26 to 6.18) among caregivers and higher odds of presenteeism among patients (2.78; 1.13 to 6.84). However, among caregivers with absenteeism more than 0 days, WFH was significantly associated with fewer absent workdays. Conclusions: Working from home was not associated with overall absenteeism and presenteeism in caregivers or patients. Working from home allows a more flexible and inclusive workplace without impacting productivity, although further research is needed.