Auxin response factors (ARFs) play important roles in regulating plant growth and development and response to environmental stress. An exhaustive analysis of the CaARF family was performed using the latest publicly available genome for pepper (Capsicum annuum L.). In total, 22 non-redundant CaARF gene family members in six classes were analyzed, including chromosome locations, gene structures, conserved motifs of proteins, phylogenetic relationships and Subcellular localization. Phylogenetic analysis of the ARFs from pepper (Capsicum annuum L.), tomato (Solanum lycopersicum L.), Arabidopsis and rice (Oryza sativa L.) revealed both similarity and divergence between the four ARF families, and aided in predicting biological functions of the CaARFs. Furthermore, expression profiling of CaARFs was obtained in various organs and tissues using quantitative real-time RT-PCR (qRT-PCR). Expression analysis of these genes was also conducted with various hormones and abiotic treatments using qRT-PCR. Most CaARF genes were regulated by exogenous hormone treatments at the transcriptional level, and many CaARF genes were altered by abiotic stress. Systematic analysis of CaARF genes is imperative to elucidate the roles of CaARF family members in mediating auxin signaling in the adaptation of pepper to a challenging environment.