Histone deacetylase (HDAC), inhibitors represent a new class of targeted anti-cancer agents. Several of these compounds are in clinical trials with significant activity against a spectrum of both hematologic and solid tumors at doses that are well tolerated by the patients. The HDAC inhibitors are a structurally diverse group of molecules that can induce growth arrest, differentiation, apoptosis, and autophagocytic cell death of cancer cells. While the base sequence of DNA provides the genetic code for proteins, the expression of genes is regulated, in large part, by the structure of the chromatin proteins around which the DNA is wrapped (epigenetic gene regulation). The acetylation and deacetylation of the lysines in the tails of the core histones, among the most extensively studied aspects of chromatin structure, is controlled by the action of two families of enzymes, histone deacetylases (HDACs) and histone acetyltransferases (HATs). Protein components of transcription factor complexes and many other non-histone proteins are also substrates for HDACs and HATs. The structure and activity of these non-histone proteins may be altered by acetylation/deacetylation with consequent effects on various cell functions including gene expression, cell cycle progression, and cell death pathways. This review focuses on several key questions with respect to the mechanism of action of HDACi, including, what are the different cell phenotypes induced by HDACi, why are normal cells compared to transformed cells relatively resistant to HDACi induced cell death, why are certain tumors more responsive to HDACi than others, and what is the basis of the selectivity of HDACi in altering gene expression. The answers to these questions will have therapeutic importance since we will identify targets for enhancing the efficacy and safety of HDACi.