Mobile genetic elements (MGEs), collectively referred to as the “mobilome”, can have a significant impact on the fitness of microbial communities and therefore on ecological processes. Marine MGEs have mainly been associated with wide geographical and phylogenetic dispersal of adaptative traits. However, whether the structure of this mobilome exhibits deterministic patterns in the natural community is still an open question. The aim of this study was to characterize the structure of the conjugative mobilome in the ocean surface bacterioplankton by searching the publicly available marine metagenomes from the TARA Oceans survey, together with molecular markers, such as relaxases and type IV coupling proteins of the type IV secretion system (T4SS). The T4SS machinery was retrieved in more abundance than relaxases in the surface marine bacterioplankton. Moreover, among the identified MGEs, mobilizable elements were the most abundant, outnumbering self-conjugative sequences. Detection of a high number of incomplete T4SSs provides insight into possible strategies related to trans-acting activity between MGEs, and accessory functions of the T4SS (e.g., protein secretion), allowing the host to maintain a lower metabolic burden in the highly dynamic marine system. Additionally, the results demonstrate a wide geographical dispersion of MGEs throughout oceanic regions, while the Southern Ocean appears segregated from other regions. The marine mobilome also showed a high similarity of functions present in known plasmid databases. Moreover, cargo genes were mostly related to DNA processing, but scarcely associated with antibiotic resistance. Finally, within the MGEs, integrative and conjugative elements showed wider marine geographic dispersion than plasmids.