Nerve sheath tumors are a group of tumors originating from Schwann cells, fibroblasts, and perineurial cells. In veterinary pathology, the terminology for nerve sheath tumors remains inconsistent, and many pathologists follow the human classification of such tumors in practice. Immunohistochemistry plays an important role in the diagnosis of nerve sheath tumors, but specific immunohistochemical and molecular biomarkers are lacking. In our study, we histopathologically reevaluated 79 canine nerve sheath tumors and assessed their reactivity for the immunohistochemical markers Sox10, claudin-1, GFAP, CNPase, and Ki-67. Based on the results, we classified the tumors according to the most recent human classification. Twelve cases were diagnosed as benign nerve sheath tumors, including six neurofibromas, three nerve sheath myxomas, two hybrid nerve sheath tumors (perineurioma/neurofibroma and perineurioma/schwannoma), and one schwannoma. Sixty-seven tumors were malignant nerve sheath tumors, including fifty-six conventional, four perineural, one epithelioid malignant nerve sheath tumor, and six malignant nerve sheath tumors with divergent differentiation. We believe that with the application of the proposed panel, an updated classification of canine nerve sheath tumors could largely follow the recent human WHO classification of tumors of the cranial and paraspinal nerves, but prospective studies would be needed to assess its prognostic value.