Non-replicating bacteria are known to be (or at least commonly thought to be) refractory to antibiotics to which they are genetically susceptible. Here, we explore the sensitivity to killing by bactericidal antibiotics of three classes of non-replicating populations of planktonic bacteria; (1) stationary phase, when the concentration of resources and/or nutrients are too low to allow for population growth; (2) persisters, minority subpopulations of susceptible bacteria surviving exposure to bactericidal antibiotics; (3) antibiotic-static cells, bacteria exposed to antibiotics that prevent their replication but kill them slowly if at all, the so-called bacteriostatic drugs. Using experimental populations of Staphylococcus aureus Newman and Escherichia coli K12 (MG1655) and respectively 9 and 7 different bactericidal antibiotics, we estimate the rates at which these drugs kill these different types of non-replicating bacteria. Contrary to the common belief that bacteria that are non-replicating are refractory to antibiotic-mediated killing, all three types of non-replicating populations of these Gram-positive and Gram-negative bacteria are consistently killed by aminoglycosides and the peptide antibiotics, daptomycin and colistin, respectively. This result indicates that non-replicating cells, irrespectively of why they do not replicate, have an almost identical response to bactericidal antibiotics. We discuss the implications of these results to our understanding of the mechanisms of action of antibiotics and the possibility of adding a short-course of aminoglycosides or peptide antibiotics to conventional therapy of bacterial infections.