Quinces are well known for their multiple health benefits, including antioxidant, hypoglycemic, antimicrobial, anti-inflammatory, anticarcinogenic, etc., properties. Despite the widespread utilization of various plant parts, the peel has been largely ignored in the industry. In this study, we explored the effects of different extraction parameters, such as temperature, time, and composition of the extraction solvent, and techniques such as ultrasound (US) and a pulsed electric field (PEF), either alone or in combination, and optimized these parameters using a response surface methodology (RSM) to enhance the extraction of bioactive compounds such as chlorogenic acid, total polyphenols, flavonoids, and ascorbic acid from waste quince peels. From our results, it was apparent that quince peels are a great source of many bioactive compounds with high antioxidant activity. More specifically, after principal component analysis (PCA) and partial least squares (PLS) analysis, quince peels contain high levels of total polyphenols (43.99 mg gallic acid equivalents/g dw), total flavonoids (3.86 mg rutin equivalents/g dw), chlorogenic acid (2.12 mg/g dw), and ascorbic acid (543.93 mg/100 g dw), as well as antioxidant activity of 627.73 μmol AAE/g and 699.61 μmol DPPH/g as evidenced by FRAP and DPPH assays, respectively. These results emphasize the potential of utilizing quince peels as an eco-friendly and cost-effective source of bioactive compounds with various applications in the food and pharmaceutical industries for the prepared extracts.