Bacterial infection is a global burden that results in numerous hospital visits and deaths annually. The rise of multi-drug resistant bacteria has dramatically increased this burden. Therefore, there is a clinical need to detect and identify bacteria rapidly and accurately in their native state or a culture-free environment. Current diagnostic techniques lack speed and effectiveness in detecting bacteria that are culture-negative, as well as options for in vivo detection. The optical detection of bacteria offers the potential to overcome these obstacles by providing various platforms that can detect bacteria rapidly, with minimum sample preparation, and, in some cases, culture-free directly from patient fluids or even in vivo. These modalities include infrared, Raman, and fluorescence spectroscopy, along with optical coherence tomography, interference, polarization, and laser speckle. However, these techniques are not without their own set of limitations. This review summarizes the strengths and weaknesses of utilizing each of these optical tools for rapid bacteria detection and identification.