The adaptive immune system has the important ability to generate and maintain a memory for antigens once encountered. Recent progress in understanding the organization of immunological memory has challenged the established paradigm of maintenance of memory by restless, circulating, and “homeostatically” proliferating lymphocytes. Among other tissues, the bone marrow has emerged as a preferred resting place for memory lymphocytes providing both local and systemic long‐term protection. Why the bone marrow? There, mesenchymal stromal cells provide a privileged environment for quiescent memory B and T lymphocytes, the protagonists of secondary immune reactions, and for memory plasma cells providing persistent humoral immunity. In this review, we discuss the dedicated role of the bone marrow for the maintenance of memory lymphocytes and its implications for immunological memory.