Select adhesion proteins control the development of synapses and modulate their structural and functional properties. Despite these important roles, the extent to which different synapse-organizing mechanisms act across brain regions to establish connectivity and regulate network properties is incompletely understood. Further, their functional roles in different neuronal populations remain to be defined. Here, we applied diffusion tensor imaging (DTI), a modality of magnetic resonance imaging (MRI), to map connectivity changes in knock-out (KO) mice lacking the synaptogenic cell adhesion protein SynCAM 1. This identified reduced fractional anisotropy in the hippocampal CA3 area in absence of SynCAM 1. In agreement, mossy fiber refinement in CA3 was impaired in SynCAM 1 KO mice. Mossy fibers make excitatory inputs onto postsynaptic specializations of CA3 pyramidal neurons termed thorny excrescences and these structures were smaller in the absence of SynCAM 1. However, the most prevalent targets of mossy fibers are GABAergic interneurons and SynCAM 1 loss unexpectedly reduced the number of excitatory terminals onto parvalbumin (PV)-positive interneurons in CA3. SynCAM 1 KO mice additionally exhibited lower postsynaptic GluA1 expression in these PV-positive interneurons. These synaptic imbalances in SynCAM 1 KO mice resulted in CA3 disinhibition, in agreement with reduced feedforward inhibition in this network in the absence of SynCAM 1-dependent excitatory drive onto interneurons. In turn, mice lacking SynCAM 1 were impaired in memory tasks involving CA3. Our results support that SynCAM 1 modulates excitatory mossy fiber inputs onto both interneurons and principal neurons in the hippocampal CA3 area to balance network excitability.