Telocytes (TCs) have been identified as a distinct type of interstitial cells, but have not yet been reported in the gastrointestinal tract (GIT) of ruminants. In this study, we used transmission electron microscopy (TEM) and double-labelling immunofluorescence (IF) (antibodies: CD34, vimentin and PGP9.5) to seek TCs and investigate their potential functions in the muscle layers of the goat rumen. TCs were distributed widely in the myenteric plexus (TC-MYs) between the circular and longitudinal muscle layers, within circular muscle layers (TC-CMs) as well as in longitudinal muscle layers (TC-LMs). Ultrastructurally, TCs displayed small cell bodies with several long prolongations—telopodes—harboring alternate thin segments (podomers) and dilated segments (podoms). The podoms contained mitochondria, rough endoplasmic reticulum, and caveolae. Telopodes frequently established close physical interactions with near telopodes, collagen fibers (CFs), nerve fibers (NFs), smooth muscle cells (SMCs), nerve tracts, and smooth muscle bundles, as well as with blood vessels (BVs). Furthermore, both homo- and heterotypic connections were observed. In addition, telopodes were capable of releasing extracellular vesicles (EVs). IF analyses proved that TCs were reliably labeled as CD34+/vimentin+ cells, displaying spindle- or triangle-shaped bodies with long prolongations, consistent with TEM results. Specifically, podoms were visible as obvious bright spots. These positive cells covered entire muscular layers, surrounding ganglions, intermuscular BVs as well as entire smooth muscle bundles, forming a network. TC-MYs were distributed as clusters in the external ganglion, encompassing the entire ganglion and spreading to the muscle layers where TC-CMs and TC-LMs seemingly surround whole smooth muscle bundles. TC-MYs were also scattered within the interior of the ganglion, surrounding each ganglionic neuron, following the glial cells layer. We speculate that TCs support the muscle layer structure of the goat rumen and facilitate intercellular signaling directly or indirectly via the TC network.