Gene co-expression networks (GCNs) generated from public transcriptomic datasets can elucidate the co-regulatory and co-functional relationships between genes, making GCNs an important tool to predict gene functions. However, current GCN construction methods are sensitive to the quality of the data, and the interpretability of the identified relationships between genes is still difficult. To address this, we present a novel method: Two-Tier Ensemble Aggregation (TEA-) GCN. TEA-GCN utilizes unsupervised partitioning of big transcriptomic datasets and three correlation coefficients to generate ensemble GCNs in a two-step aggregation process. We show that TEA-GCN outperforms in finding correct functional relationships between genes over the current state-of-the-art across three model species, and is able to not only capture condition/tissue-specific gene co-expression but explain them through the use of natural language processing (NLP). In addition, we found TEA-GCN to be especially performant in identifying relationships between transcription factors and their activation targets, making it effective in inferring gene regulatory networks. TEA-GCN is available at https://github.com/pengkenlim/TEA-GCN.