Histone deacetylase 6 (HDAC6) inhibition is a potential treatment of a wide range of cancer types via the acetylation of diverse proteins in the cytoplasm. However, the regulation of histone acetylation and the maintenance of higher-order chromatin structure remains unidentified. Here, we investigated the effect of selective inhibition of HDAC6 by histone acetylation, chromatin relaxation assays, co-immunoprecipitation, acetylome peptide array and in vivo RNA microarray. Our data shows that nuclear HDAC6 physically interacts with the Histone 4 lysine 12 residue, and that HDAC6 inhibition increases acetylation specifically at this residue in several cancer types. Inhibition induces major chromatin structure modulation, but has no equivalent effect on knockout HDAC6-/- MEF cells. We identified several novel HDAC6-deacetylated substrates and high expression of HDAC6 in colorectal cancer (CRC) tissue association with reduced levels of H4K12ac and independent of the key CRC driver mutations, but positively associated with EGFR expression. Furthermore, in vivo HDAC6 inhibition induces significant tumor regression in a CRC xenograft mice model with significant changes in the expression of functional nuclear genes. We also demonstrated that a DNA damaging agent in combination with selective HDAC6 inhibition is effective and acts synergistically, inducing chromatin relaxation and increased cell death in CRC cells. CRC tissues (Normal versus tumor; n=58 matched pairs) together with TCGA data analysis of 467 CRC patients showed that high HDAC6 expression is associated with metastasis, overall and disease-free survival, and is an independent risk factor of CRC stage progression. Our findings designate a new role for nuclear HDAC6 both in cancer prognosis and as a new therapeutic target for CRC and other types of cancer.