The multiple agroforestry land uses of oak forests are of great ecological and economic interest as they contribute to the improvement of animal husbandry, wildlife, and environment. However, herbivory by wildlife and livestock highly affects the structure and the dynamic of forest ecosystems including its regeneration. The aim of this study was to investigate the comparative effect of wild boar and small ruminants herbivory on the regeneration of a deciduous oak forest in northern Greece. Eight sites were selected in an even aged stand of similar canopy cover and forest site quality: four sites with long-time use mainly by wild boar and four sites with long-time grazing by sheep and browsing by goats. A plot of 150 m2 in each of the sites was fenced in order to be protected from herbivory. The plant cover and number of oak seedlings and acorns was measured in both grazed and protected plots for four consecutive years. The plant cover increased in the protected plots independent of the type of animals. The seedling cover decreased about 29% and 9% in sites where small ruminants and wild boars foraged respectively. Similarly, the number and the weight of acorns significantly decreased in the sites grazed by small ruminants mainly during the mast year of the oaks. Forest management has to control the small ruminants grazing in terms of intensity, timing, and duration in order to ensure the sustainability of the ecosystem.