Enzyme activities that improve digestion of recalcitrant plant cell wall polysaccharides may offer solutions for sustainable industries. To this end, anaerobic fungi in the rumen have been identified as a promising source of novel carbohydrate active enzymes (CAZymes) that modify plant cell wall polysaccharides and other complex glycans. Many CAZymes share insufficient sequence identity to characterized proteins from other microbial ecosystems to infer their function; thus presenting challenges to their identification. In this study, four rumen fungal genes (, ,, and ) were identified that encode family 39 glycoside hydrolases (GH39s), and have conserved structural features with GH51s. Two recombinant proteins, NF2152 and NF2523, were characterized using a variety of biochemical and structural techniques, and were determined to have distinct catalytic activities. NF2152 releases a single product, β1,2-arabinobiose (Ara) from sugar beet arabinan (SBA), and β1,2-Ara and α-1,2-galactoarabinose (Gal-Ara) from rye arabinoxylan (RAX). NF2523 exclusively releases α-1,2-Gal-Ara from RAX, which represents the first description of a galacto-(α-1,2)-arabinosidase. Both β-1,2-Ara and α-1,2-Gal-Ara are disaccharides not previously described within SBA and RAX. In this regard, the enzymes studied here may represent valuable new biocatalytic tools for investigating the structures of rare arabinosyl-containing glycans, and potentially for facilitating their modification in industrial applications.