Background: Gender-affirming mastectomy (GAM) improves the psychosocial functioning and quality of life of transgender and non-binary (TGNB) individuals. However, the perioperative period is often marked by emotional stress, concerns about surgical outcomes, and physical discomfort. While inpatient procedures provide multiple opportunities to engage with and educate patients, outpatient surgeries, such as GAM, pose a unique challenge as patients are followed for <24 h postoperatively. Given the heightened emotional and psychological distress related to gender dysphoria TGNB individuals often experience, addressing these gaps can significantly improve outcomes. This study aims to characterize patient and surgical characteristics associated with patient-initiated communication (PIC) frequency in this population. Methods: A single-center retrospective review of TGNB patients undergoing GAM from February 2018 to November 2022 was conducted. Demographics, surgical characteristics, and frequency of and reasons for perioperative PIC (30 days before and after surgery) were recorded. The primary outcome was the incidence of perioperative PIC. The secondary outcomes included (1) the rationale for PIC and (2) patient and surgical characteristics associated with PIC. Results: A total of 352 patients were included. Of these, 285 (74.6%) initiated communication in the perioperative period, totaling 659 PICs. The median age was 25.0 (interquartile range [IQR]: 9.0) years. The median body mass index (BMI) was 28.5 (IQR: 8.5) kg/m2. The mean number of PICs was 0.7 ± 1.3 preoperatively and 1.3 ± 1.7 postoperatively (p < 0.001). The most frequent preoperative PIC subjects were administrative issues (AI; n = 66, 30.7%), preoperative requirements (n = 43, 20.0%), and cost and insurance (n = 33, 15.0%). The most frequent postoperative PIC subjects were wound care (n = 77, 17.3%), AI (n = 70, 15.0%), activity restrictions (n = 60, 13.5%), drainage (n = 56, 12.6%), and swelling (n = 37, 8.3%). Collectively, older patients (β = 0.234, p = 0.001), those with a history of major depressive disorder or generalized anxiety disorder (2.4 ± 3.0 vs. 1.7 ± 1.9; p = 0.019), and those without postoperative drains (n = 16/17, 94.1% vs. n = 236/334, 70.7%; p = 0.025) engaged in higher levels of PIC. There were no significant associations between other patient characteristics, perioperative details, or complications and PIC frequency. Conclusions: Perioperative PIC is prevalent among the majority of GAM patients at our institution, with age, psychiatric diagnosis, and postoperative drain use identified as significant predictors. To mitigate PIC frequency, it is crucial to ensure adequate support staffing and provide comprehensive postoperative instructions, particularly concerning activity restrictions and drainage management. These interventions may reduce PICs in high-volume centers. Further research should investigate targeted interventions to further support TGNB patients during the perioperative period.