The development of selective butyrylcholinesterase (BChE) inhibitors may improve the treatment of Alzheimer’s disease by increasing lower synaptic levels of the neurotransmitter acetylcholine, which is hydrolysed by acetylcholinesterase, as well as by overexpressed BChE. An increase in the synaptic levels of acetylcholine leads to normal cholinergic neurotransmission and improved cognitive functions. A series of 14 novel heterocyclic β-d-gluco- and β-d-galactoconjugates were designed and screened for inhibitory activity against BChE. In the kinetic studies, 4 out of 14 compounds showed an inhibitory effect towards BChE, with benzimidazolium and 1-benzylbenzimidazolium substituted β-d-gluco- and β-d-galacto-derivatives in a 10–50 micromolar range. The analysis performed by molecular modelling indicated key residues of the BChE active site, which contributed to a higher affinity toward the selected compounds. Sugar moiety in the inhibitor should enable better blood–brain barrier permeability, and thus increase bioavailability in the central nervous system of these compounds.