The contribution of epigenetic mechanisms in diabetes mellitus (DM), β-cell reprogramming and its complications is an emerging concept. Recent evidence suggests that there is a link between DM and histone deacetylases (HDACs), because HDAC inhibitors promote β-cell differentiation, proliferation, function and improve insulin resistance. Moreover, gut microbes and diet-derived products can alter the host epigenome. Furthermore, butyrate and butyrate-producing microbes are decreased in DM. Butyrate is a short-chain fatty acid produced from the fermentation of dietary fibers by microbiota and has been proven as an HDAC inhibitor. The present review provides a pragmatic interpretation of chromatin-dependent and independent complex signaling/mechanisms of butyrate for the treatment of Type 1 and Type 2 DM, with an emphasis on the promising strategies for its drugability and therapeutic implication.