Recent research has demonstrated the positive impact of herbal tea consumption on postprandial blood glucose regulation. This study conducts a comparative analysis of aqueous and ethanol extractions on four herbal teas (Mallotus, Cyclocarya, Rubus, and Vine) to assess their phytochemical profiles and functional attributes. Phytochemical contents, antioxidant activities, α-glucosidase inhibitory activities, and chemical compositions are investigated via colorimetric analyses and UPLC-Q-Orbitrap HRMS/MS, respectively. Results indicate that Vine, among the teas studied, exhibits the most pronounced glucose-regulating effects under both extraction methods. While ethanol extractions yield higher phytochemical content overall, the compositions vary. Conversely, aqueous extracts demonstrate unexpectedly potent antioxidant activities and comparable α-glucosidase inhibitory activities to ethanol extracts. Phytochemical contents correlate positively with antioxidant activities and α-glucosidase inhibitory activities. However, antioxidant activities exhibit a weak positive correlation with α-glucosidase inhibitory activities. These findings provide evidence that aqueous extracts from herbal teas contain valuable phytochemical compositions beneficial for antioxidants and individuals with hyperglycemia, suggesting their potential as functional ingredients to enhance the nutritional value of herbal food products.