Psilidae (Diptera: Brachycera) is a moderate-sized family currently placed in the superfamily Diopsoidea and contains some destructive agricultural and forestry pests. The systematic position and intrafamilial classification of rust flies are in need of further study, and the available molecular data of Psilidae are still limited. In this study, we present the mitochondrial genomes of 6 Psilidae species (Chamaepsilatestudinaria Wang and Yang, Chyliza bambusae Wang and Yang, Chy. chikuni Wang, Loxocera lunata Wang and Yang, L. planivena Wang and Yang and L. sinica Wang and Yang). Comparative analyses show a conserved genome structure, in terms of gene composition and arrangement, and a highly Adenine plus Thymine biased nucleotide composition of the 6 psilid mitogenomes. Mitochondrial evolutionary rates vary among the 6 species, with species of Chylizinae exhibiting a slower average rate than species of Psilinae. The length, the nucleotide composition, and the copy number of repeat units of the control region are variable among the 6 species, which may offer useful information for phylogenetic and evolutionary studies of Psilidae. Phylogenetic analyses based on 4 mitogenomic datasets (AA, PCG, PCG12RNA, and PCGRNA) support the monophyly of Psilidae, and the sister relationship between Chylizinae and Psilinae, while Diopsoidea is suggested to be non-monophyletic. Our study enlightens the future application of mitogenomic data in the phylogenetic and evolutionary studies of Psilidae, based on denser taxon sampling.