Specialized metabolites not only play important roles in biotic and abiotic stress adaptation of tea plants (Camellia sinensis (L.) O. Kuntze) but also contribute to the unique flavor of tea, the most important nonalcoholic beverage. However, the molecular networks and major genes that regulate specialized metabolites in tea plants are not well understood. Here, we constructed a population-level pan-transcriptome of the tea plant leaf using second-leaf transcriptome data from 134 accessions to investigate global expression differences in the population, expression presence or absence variations (ePAVs), and differentially expressed genes (DEGs) between pure Camellia sinensis var. assamica (CSA) and pure Camellia sinensis var. sinensis (CSS) accessions. Next, we used a genome-wide association study, a quantitative trait transcript study, and a transcriptome-wide association study to integrate genotypes, accumulation levels of specialized metabolites, and expression levels of pan-transcriptome genes to identify candidate regulatory genes for flavor-related metabolites and to construct a regulatory network for specialized metabolites in tea plants. The pan-transcriptome contains 30 482 expressed genes, 4940 and 5506 of which were newly annotated from a de novo transcriptome assembly without a reference and a genome reference-based assembly, respectively. DEGs and ePAVs indicated that CSA and CSS were clearly differentiated at the population transcriptome level, and they were closely related to abiotic tolerance and secondary metabolite synthesis phenotypes of CSA and CSS based on gene annotations. The regulatory network contained 212 specialized metabolites, 3843 candidate genes, and 3407 eQTLs, highlighting many pleiotropic candidate genes, candidate gene-rich eQTLs, and potential regulators of specialized metabolites. These included important transcription factors in the AP2/ERF-ERF, MYB, WD40, and bHLH families. CsTGY14G0001296, an ortholog of AtANS, appeared to be directly related to variation in proanthocyanins in the tea plant population, and the CsTGY11G0002074 gene encoding F3′5′H was found to contribute to the biased distribution of catechins between pure CSAs and pure CSSs. Together, these results provide a new understanding of the metabolite diversity in tea plants and offer new insights for more effective breeding of better-flavored tea varieties.