Recent breakthroughs in immune checkpoint inhibitors (ICIs) have shown promise in triple-negative breast cancer (TNBC). Due to the intrinsic heterogeneity among TNBC, clinical response to ICIs varies greatly among individuals. Thus, discovering rational biomarkers to select susceptible patients for ICIs treatment is warranted. A total of 422 TNBC patients derived from The Cancer Genome Atlas (TCGA) database and Molecular Taxonomy of Breast Cancer International Consortium (METABRIC) dataset were included in this study. High immunogenic gene modules were identified using weighted gene co-expression network analysis (WGCNA). Immune-related genes (IRGs) expression patterns were generated by consensus clustering. We developed a three-gene signature named immune-related gene panel (IRGP) by Cox regression method. Afterward, the associations of IRGP with survival outcomes, infiltration of immune cells, drug sensitivity, and the response to ICIs therapy were further explored. We found five high immunogenic gene modules. Two distinct IRGclusters and IRG-related genomic clusters were identified. The IRGP was constructed based on TAPBPL, FBP1, and GPRC5C genes. TNBC patients were then subdivided into high- and low-IRGriskscore subgroups. TNBC patients with low IRGriskscore had a better survival outcome, higher infiltration of immune cells, lower TP53 mutation rate, and more benefit from ICIs treatment than high IRGriskscore patients. These findings offer novel insights into molecular subtype of TNBC and provided potential indicators for guiding ICIs treatment.