The Chinese soft-shelled turtle (Pelodiscus sinensis) is an economically important species in aquaculture, and its growth pattern is characterized by significant sexual dimorphism. However, the underlying molecular mechanisms of this phenomenon have mostly been investigated in the gonadal tissues of P. sinensis, and there are no articles on sex differentiation from the brain of P. sinensis. Here, we analyzed transcriptomes of the brains of adult male and female P. sinensis using high-throughput Illumina sequencing technology, establishing a set of differential genes and differential transcription factors. The data showed that there were 908 genes with significant differences in expression, of which 357 genes were up-regulated and 551 genes were down-regulated. We annotated using Gene Ontology (GO) and the Kyoto Encyclopedia of Genes and Genomes (KEGG), and screened some genes and pathways related to growth. There were 282 growth-related differential genes and 181 sex-related differential genes. We screened the genes’ growth hormone receptor (GHR) and vascular endothelial growth factor A (VEGFA), which may be related to the growth of P. sinensis. The pathways related to the growth and development of P. sinensis are the growth hormone synthesis, secretion, and action pathway; the MAPK (mitogen-activated protein kinase) pathway; and the calcium signaling pathway. In addition, through gene set enrichment analysis (GSEA), we screened out two genes, LIM homeobox protein 1 (LHX1) and fibroblast growth factor 7 (FGF7), which are related to both growth and sex differentiation, and through protein interaction analysis of these genes, we screened out eight genes, including LHX1, FGF7, GHR, fibroblast growth factor 4 (FGF4), EGFR, BMP3, GLI family zinc finger 2 (GLI2), and neuronal differentiation 1 (NEUROD1), and verified the expression levels of these eight genes in the brain of the P. sinensis by real-time quantitative PCR (qRT-PCR), which supported the reliability and accuracy of our transcriptome analysis. Our study provides a solid foundation for analyzing the mechanisms of sexual-dimorphic growth of P. sinensis and even other turtles.