Primary bone marrow diffuse large B-cell lymphoma (DLBCL) is rare, and only a few cases have been reported. Fever and arthralgia as the initial symptom are extremely rare; however, awareness must be made of this presentation. The current study describes the clinical and pathological findings of a 41-year-old man affected by fever and arthralgia. Blood tests revealed leukopenia and anemia. Multiple bone marrow biopsies were conducted and confirmed the diagnosis of primary bone marrow DLBCL. Primary bone marrow DLBCL is a rare and frequently misdiagnosed subset of non-Hodgkin's lymphoma. The current case demonstrates that utility of bone marrow biopsy for diagnosis should not be ignored, and that repeated bone marrow punctures in multiple locations may be necessary.