Prolyl oligopeptidases cleave peptides on the carboxy side of internal proline residues and their inhibition has potential in the treatment of human brain disorders. Using our docking program fitted, we have designed a series of constrained covalent inhibitors, built from a series of bicyclic scaffolds, to study the optimal shape required for these small molecules. These structures bear nitrile functional groups that we predicted to covalently bind to the catalytic serine of the enzyme. Synthesis and biological assays using human brain-derived astrocytic cells and endothelial cells and human fibroblasts revealed that these compounds act as selective inhibitors of prolyl oligopeptidase activity compared to prolyl-dipeptidyl-aminopeptidase activity, are able to penetrate the cells and inhibit intracellular activities in intact living cells. This integrated computational and experimental study shed light on the binding mode of inhibitors in the enzyme active site and will guide the design of future drug-like molecules.