Mycobacterium abscessus is the most difficult-to-treat nontuberculous mycobacteria because of its resistance to many antibiotics. In this study, we screened the Korea Chemical Bank library for a bioluminescent reporter assay to identify molecules capable of acting against M. abscessus. On application of the assay, rifamycin O showed excellent in vitro activity with a narrow range of the minimum inhibitory concentration required to inhibit the growth of 90% of the bacterium (MIC90 = 4.0–6.2 μM); its in vivo efficacy in the zebrafish (Danio rerio) infection model was comparable to that of rifabutin at 25 μM. Furthermore, rifamycin O did not show significant toxicity in cells and the zebrafish model. These results are the first in vivo indication that rifamycin O may be a drug candidate for treating M. abscessus infections.