The human prefrontal cortex (PFC) differs from that of other primates with respect to size, histology, and functional abilities. Here, we analyzed genome-wide expression data of humans, chimpanzees, and rhesus macaques to discover evolutionary changes in transcription factor (TF) networks that may underlie these phenotypic differences. We determined the co-expression networks of all TFs with species-specific expression including their potential target genes and interaction partners in the PFC of all three species. Integrating these networks allowed us inferring an ancestral network for all three species. This ancestral network as well as the networks for each species is enriched for genes involved in forebrain development, axonogenesis, and synaptic transmission. Our analysis allows us to directly compare the networks of each species to determine which links have been gained or lost during evolution. Interestingly, we detected that most links were gained on the human lineage, indicating increase TF cooperativity in humans. By comparing network changes between different tissues, we discovered that in brain tissues, but not in the other tissues, the human networks always had the highest connectivity. To pinpoint molecular changes underlying species-specific phenotypes, we analyzed the sub-networks of TFs derived only from genes with species-specific expression changes in the PFC. These sub-networks differed significantly in structure and function between the human and chimpanzee. For example, the human-specific sub-network is enriched for TFs implicated in cognitive disorders and for genes involved in synaptic plasticity and cognitive functions. Our results suggest evolutionary changes in TF networks that might have shaped morphological and functional differences between primate brains, in particular in the human PFC.