Small surface-release dams are prevalent across North American watersheds and can alter stream flow, thermal regimes, nutrient dynamics, and sediment transport. These dams are often implicated as a cause of negative water quality impacts—including reduced dissolved oxygen (DO)—and dam removal is increasingly employed to restore natural stream processes and improve DO. Published impacts of small dams on DO vary widely across sites, and even less is known about the extent and timescale of DO recovery following removal. Therefore, we sought to quantify the effects of small dams and dam removal on DO and determine the dam, stream, and watershed characteristics driving inter-site variation in responses. We deployed continuous data loggers for 3 weeks during summer months in upstream (reference), impoundment, and downstream reaches at each of 15 dammed sites and collected equivalent data at 10 of those sites following dam removal. Prior to dam removal, most sites (60%) experienced a decrease in DO (an average of 1.15 mg/L lower) within the impoundment relative to upstream, but no consistent impacts on diel ranges or on downstream reaches. Before dam removal, 5 impacted stream reaches experienced minimum DO levels below acceptable water quality standards (<5 mg/L); after dam removal, 4 of 5 of these reaches met DO standards. Sites with wider impoundments relative to upstream widths and sites located in watersheds with more cultivated land experienced the greatest decreases in impoundment DO relative to upstream. Within one year following dam removal, impoundment DO recovered to upstream reference conditions at 80% of sites, with the magnitude of recovery strongly related to the magnitude of pre-removal impacts. These data suggest that broadly, small dams negatively affect stream DO, and the extent of effects are modulated by impoundment geometry and watershed characteristics. These results may help practitioners to prioritize restoration efforts at those sites where small dams are having outsized impacts, and therefore where the greatest water quality benefits may occur.