Overwintering survival by insects, whether of the freeze-tolerant or freeze-avoiding types, is typically associated with a strong suppression of metabolic rate (e.g., entry into diapause) that involves the differential expression of many genes with regulation at the transcriptional, translational or post-translational levels. Epigenetic modifications have been suggested to play a vital role in regulating cold responses of insects. However, knowledge of the roles of epigenetic mechanisms in modulating gene expression for winter survival of the larvae of two goldenrod gall formers, the freeze-tolerant dipteran Eurosta solidaginis and the freeze-avoiding lepidopteran Epiblema scudderiana, remain unknown. The current study evaluates the role of cold-induced lysine methylation and histone modifications, with enzymes of lysine methylation (SETD8, SETD7, SUV39H1, SMYD2 and ASH2L), as well as relative levels of histone H3 acetylation (H3K9ac, H3K18ac, H3K27ac, H3K56ac) and methylation (H3K4me1, H3K9me3, H3K36me2) examined in two insects. Significant (p < 0.05) reductions were observed in most of the targets of histone methylation/acetylation for decreasing temperatures of Ep. scudderiana larvae, whereas selected histone methylation/acetylation targets were conversely elevated (p < 0.05) in E. solidaginis, particularly under conditions of 5 °C for 4 h. Histone H3 expression was found to be variable without statistical differences in larval goldenrod gall moths and gall flies. These results provide basic information on the patterns of epigenetic regulation involved in insect cold hardiness.