Farming impacts animal-mediated seed dispersal through mechanisms operating on at least two spatial scales. First, at the landscape scale, through habitat loss and land conversion to agriculture/livestock grazing, and second, at the farm scale, via a local intensification of agricultural practices. These two scales of farming impact seed dispersal function but have rarely been integrated. In particular, studies evaluating the effect of agriculture on the seed dispersal function of frugivorous birds in Mediterranean ecosystems are lacking. This study evaluates the role of landscape transformation, from fruit-rich woodland habitats to olive grove landscapes, together with local intensive practices of soil management on the persistence of the seed dispersal function for Mediterranean fleshy-fruited plants in olive landscapes of south Spain. We used bird censuses, mist-nets, and seed traps to characterize avian frugivore assemblages, frugivory, and seed deposition in the seminatural woodland habitat (SNWH) patches and olive fields of 40 olives farms spanning 20 localities distributed across the whole range of olive cultivation in Andalusia (southern Spain). We found that despite the remarkable dispersal function of olive grove landscapes, avian frugivore abundance and diversity, frugivory, and seed arrival decreased in olive fields compared to SNWH patches. Likewise, SNWH cover loss and/or olive growing expansion decreased avian frugivory and seed arrival. Interestingly, the habitat effects in the olive farms often depended on the landscape context. In particular, less diverse fruit-eating bird assemblages pooled in SNWH patches as olive grove cover increased or SNWH decreased in the landscape, while remaining relatively invariant in the olive fields. Finally, compared to conventional intensive agriculture, low-intensity management increased frugivory and seed deposition. We conclude that olive fields are less permeable to frugivores than expected due to the agroforest-like nature of these landscapes and that the presence of SNWH patches is crucial for the maintenance of frugivory and seed dispersal in agricultural landscapes. These results evidence that woodland habitat loss by olive expansion and intensive practices seriously threaten the dispersal service in olive-dominated landscapes. Maintenance, restoration, and promotion of woodland patches should be prioritized for the conservation of seed dispersal service and for enhancing the functional connectivity in human-shaped olive landscapes.