This mini-review deals with some non-starter lactic acid bacteria (NSLAB) species with a controversial nature known to be both human and animal pathogens but also health-promoting and probiotic. The focus is put on Lactococcus garvieae, two Streptococcus species (Str. uberis and Str. parauberis), four Weissella species (W. hellenica, W. confusa, W. paramesenteroides and W. cibaria) and Mammalicoccus sciuri which worldwide are often found within the microbiotas of different kinds of cheese, mainly traditional artisanal ones made from raw milk and/or relying on environmental bacteria for their ripening. Based on literature data, their virulence and health-promoting effects are examined, and some of the mechanisms of these actions are investigated. Additionally, their possible roles in cheese ripening are also discussed. The analysis so far showed that, in general, the pathogenic and the beneficial strains, despite belonging to the same species, show pretty different genetic constitutions. Yet, when the safety of a given strain is assessed, genomic analysis on its own is not enough, and a polyphasic approach is needed including additional physiological and functional tests.