The gut microbiota produces metabolites such as short-chain fatty acids (SCFAs) that regulate the energy homeostasis and impact on immune cell function of the host. Recently, innovative approaches based on the oral administration of SCFAs have been discussed for therapeutic modification of inflammatory immune responses in autoimmune diseases. So far, most studies have investigated the SCFA-mediated effects on CD4+ T cells and antigen presenting cells. Here we show that butyrate and, to a lesser degree, propionate directly modulate the gene expression of CD8+ cytotoxic T lymphocytes (CTLs) and Tc17 cells. Increased IFN-γ and granzyme B expression by CTLs as well as the molecular switch of Tc17 cells towards the CTL phenotype was mediated by butyrate independently of its interaction with specific SCFA-receptors GPR41 and GPR43. Our results indicate that butyrate strongly inhibited histone-deacetylases (HDACs) in CD8+ T cells thereby affecting the gene expression of effector molecules. Accordingly, the pan-HDAC inhibitors trichostatin A (TSA) and sodium valproate exerted similar influence on CD8+ T cells. Furthermore, higher acetate concentrations were also able to increase IFN-γ production in CD8+ T lymphocytes by modulating cellular metabolism and mTOR activity. These findings might have significant implications in adoptive immunotherapy of cancers and in anti-viral immunity.