Triple-negative breast cancer (TNBC) lacks an effective treatment target and is usually associated with a poor clinical outcome; however, hormone unresponsiveness, which is the most important biological characteristic of TNBC, only means the lack of nuclear estrogenic signaling through the classical estrogen receptor (ER), ER-α. Several sex steroid receptors other than ER-α: androgen receptor (AR), second ER, ER-β, and non-nuclear receptors represented by G-protein-coupled estrogen receptor (GPER), are frequently expressed in TNBC and their biological and clinical importance has been suggested by a large number of studies. Despite the structural similarity between each sex steroid hormone (androgens and estrogens) or each receptor (AR and ER-β), and similarity in the signaling mechanisms of these hormones, most studies or reviews focused on one of these receptors, and rarely reviewed them in a comprehensive way. Considering the coexistence of these hormones and their receptors in TNBC in a clinical setting, a comprehensive viewpoint would be important to correctly understand the association between the carcinogenic mechanism or pathobiology of TNBC and sex steroid hormones. In this review, the carcinogenic or pathobiological role of sex steroid hormones in TNBC is considered, focusing on the common and divergent features of the action of these hormones.