In this study, we evaluated the antimicrobial activity of bacteria isolated from the marine sponges Hymeniacidon perlevis and Halichondria panicea against seven Acinetobacter baumannii strains, the majority of which were clinically relevant carbapenem-resistant Acinetobacter baumannii (CRAb) strains. We observed the inhibitory activity of 18 (out of 114) sponge-isolated bacterial strains against all A. baumanii strains using medium-throughput solid agar overlay assays. These inhibitory strains belonged to the genera Lactococcus, Pseudomonas and Vagococcus. In addition, this antimicrobial activity was validated through a liquid co-cultivation challenge using an inhibitory strain of each genus and a GFP-tagged A. baumanii strain. Fluorescence measurements indicated that the growth of A. baumanii was inhibited by the sponge isolates. In addition, the inability of A. baumanii to grow after spreading the co-cultures on solid medium allowed us to characterize the activity of the sponge isolates as bactericidal. In conclusion, this study demonstrates that marine sponges are a reservoir of bacteria that deserves to be tapped for antibiotic discovery against A. baumanii.