In a nerve terminal, synaptic vesicle docking and release are restricted to an active zone. The active zone is a protein scaffold that is attached to the presynaptic plasma membrane and opposed to postsynaptic receptors. Here, we generated conditional knockout mice removing the active zone proteins RIM and ELKS, which additionally led to loss of Munc13, Bassoon, Piccolo, and RIM-BP, indicating disassembly of the active zone. We observed a near complete lack of synaptic vesicle docking and a strong reduction in vesicular release probability and the speed of exocytosis, but total vesicle numbers, SNARE protein levels, and postsynaptic densities remained unaffected. Despite loss of the priming proteins Munc13 and RIM and of docked vesicles, a pool of releasable vesicles remained. Thus, the active zone is necessary for synaptic vesicle docking and to enhance release probability, but releasable vesicles can be localized distant from the presynaptic plasma membrane.