RabGTPase activating proteins (RabGAP) are responsible for directing the deactivation of vesicular trafficking master regulators associated to plant development, the RabGTPase proteins. Recently, RabGAPs were identified in Arabidopsis and rice, but studies were not yet reported in tomato. Herein, we identified 24 RabGAP-encoding genes in cultivated tomato (Solanum lycopersicum) and its wild relative genomes (Solanum pimpinellifolium and Solanum pennellii). We analyzed them based on their exon-intron structures, conserved protein motifs, putative subcellular localizations, phylogenetic and gene duplications analyses, interaction networks, and gene expression patterns in tomato. Phylogenetic relationship analysis also indicated that RabGAP family is classified into seven subclasses, of which subclasses I and II are plant-exclusive. Furthermore, segmental duplication events and positive evolutionary forces are associated with the maintenance of the number and function of their members. On the other hand, the protein–protein interaction networks on tomato suggested that members of subclasses I, II, and III could be associated to endocytic traffic routes. In addition, the qRT-PCR experiments in S. lycopersicum and Solanum chilense exposed to a salt stress treatment validated the differential expression patterns of 20 RabGAP genes in different tissues, development stages, and stress conditions obtained through extensive microarray-based analyses. This work suggests the critical role of RabGAP family in the context of intracellular vesicular trafficking in tomato, particularly under conditions of abiotic stress. It also contributes to the breeding programs associated with the development of crops tolerant to salt stress.