Serotonin (5-HT) has been reported to play an important role in mammary gland involution that is defined as the process through which the gland returns to a nonlactating state. However, the overall picture of the regulatory mechanisms of 5-HT and the effects of serotonylation on mammary gland involution still need to be further investigated. The current study aimed to investigate the effects of 5-HT on global gene expression profiles of bovine mammary epithelial cells (MAC-T) and to preliminarily examine whether the serotonylation involved in the mammary gland involution by using Monodansylcadaverine (MDC), a competitive inhibitor of transglutaminase 2. Results showed that a high concentration of 5-HT decreased viability and transepithelial electrical resistance (TEER) in MAC-T cells. Transcriptome analysis indicated that 2477 genes were differentially expressed in MAC-T cells treated with 200 μg/mL of 5-HT compared with the control group, and the Notch, p53, and PI3K-Akt signaling pathways were enriched. MDC influenced 5-HT-induced MAC-T cell death, fatty acid synthesis, and the formation and disruption of tight junctions. Overall, a high concentration of 5-HT is able to accelerate mammary gland involution, which may be regulated through the Notch, p53, and PI3K-Akt signaling pathways. Serotonylation is involved in bovine mammary gland involution.