Histiocytic sarcoma (HS) is an aggressive and rare hematological malignancy. Its treatment has not been established, and most patients die within 2 years of diagnosis. Resection can provide a favorable prognosis for solitary lesions. We present the case of an 80-year-old Japanese man with HS. He presented a history of a slow-growing painless mass in the lower part of his right jaw. Ultrasonography showed a swollen lymph node in the vicinity of the right submandibular gland. Contrast-enhanced computed tomography revealed a heterogeneous, low-contrast mass on the right of the neck. Magnetic resonance imaging revealed a heterogeneously enhanced mass in gadolinium-enhanced T1-weighted images. The fine needle biopsy showed spindle-shaped cells and HS was suspected. Fluorodeoxyglucose positron emission tomography revealed uptake by the tumor alone. The patient underwent right upper neck dissection and resection of the submandibular salivary glands. No postoperative adjuvant treatment was administered, but 2-year survival was achieved. Histopathological examination showed proliferation of large, pleomorphic atypical cells without differentiation into lymphocytes, which proved their differentiation into histiocytes. A bone marrow biopsy showed no evidence of monocytic leukemia. Thus, a diagnosis of HS was made. With local treatment alone, our patient achieved long-term survival, maintaining his quality of life.