Objectives The COVID-19 pandemic has led to the widespread uptake of virtual care in Canada; however, virtual care may also create new barriers to health care. The purpose of this paper was to explore patient perceptions and concerns around virtual care access. Methods Between February and April 2020, we conducted semi-structured interviews with participants from four chronic disease clinics (stroke, epilepsy, amyotrophic lateral sclerosis, obstetrics medicine) in a mid-sized academic hospital in Southern Ontario, Canada. Consecutive sampling was done by including the patients receiving virtual care in those months. Caregivers were invited to participate in the event that patients were unable to participate in the interview. Thematic analysis was employed to identify overarching themes, and codes were reviewed and refined using a consensus process. Results We interviewed 31 participants (27 patients, four caregivers) that had taken part in virtual care. Our findings suggested that the COVID-19 pandemic served to isolate participants and had negatively impacted their access to health care. However, virtual care did provide a safe avenue for patients to receive care and served as a reassuring option during the pandemic. Low technological literacy and access were identified as barriers to virtual care. Greater awareness and patient engagement is needed in future research to improve access. Conclusion Certain populations can be disproportionately affected by differential access to virtual care. Future studies should examine how social determinants intersect to impact virtual health care access in different patient populations.