DNA mismatch repair is critical for increasing replication fidelity in organisms ranging from bacteria to humans. MutS protein, a member of the ABC ATPase superfamily, recognizes mispaired and unpaired bases in duplex DNA and initiates mismatch repair. Mutations in human MutS genes cause a predisposition to hereditary nonpolyposis colorectal cancer as well as sporadic tumours. Here we report the crystal structures of a MutS protein and a complex of MutS with a heteroduplex DNA containing an unpaired base. The structures reveal the general architecture of members of the MutS family, an induced-fit mechanism of recognition between four domains of a MutS dimer and a heteroduplex kinked at the mismatch, a composite ATPase active site composed of residues from both MutS subunits, and a transmitter region connecting the mismatch-binding and ATPase domains. The crystal structures also provide a molecular framework for understanding hereditary nonpolyposis colorectal cancer mutations and for postulating testable roles of MutS.

RNase H belongs to a nucleotidyl-transferase superfamily, which includes transposase, retroviral integrase, Holliday junction resolvase, and RISC nuclease Argonaute. We report the crystal structures of RNase H complexed with an RNA/DNA hybrid and a mechanism for substrate recognition and two-metal-ion-dependent catalysis. RNase H specifically recognizes the A form RNA strand and the B form DNA strand. Structure comparisons lead us to predict the catalytic residues of Argonaute and conclude that two-metal-ion catalysis is a general feature of the superfamily. In nucleases, the two metal ions are asymmetrically coordinated and have distinct roles in activating the nucleophile and stabilizing the transition state. In transposases, they are symmetrically coordinated and exchange roles to alternately activate a water and a 3'-OH for successive strand cleavage and transfer by a ping-pong mechanism.

Nucleases cleave the phosphodiester bonds of nucleic acids and may be endo or exo, DNase or RNase, topoisomerases, recombinases, ribozymes, or RNA splicing enzymes. In this review, I survey nuclease activities with known structures and catalytic machinery and classify them by reaction mechanism and metal-ion dependence and by their biological function ranging from DNA replication, recombination, repair, RNA maturation, processing, interference, to defense, nutrient regeneration or cell death. Several general principles emerge from this analysis. There is little correlation between catalytic mechanism and biological function. A single catalytic mechanism can be adapted in a variety of reactions and biological pathways. Conversely, a single biological process can often be accomplished by multiple tertiary and quaternary folds and by more than one catalytic mechanism. Two-metal-ion-dependent nucleases comprise the largest number of different tertiary folds and mediate the most diverse set of biological functions. Metal-ion-dependent cleavage is exclusively associated with exonucleases producing mononucleotides and endonucleases that cleave double- or single-stranded substrates in helical and base-stacked conformations. All metal-ion-independent RNases generate 2',3'-cyclic phosphate products, and all metal-ion-independent DNases form phospho-protein intermediates. I also find several previously unnoted relationships between different nucleases and shared catalytic configurations.