Habitat fragmentation can have severe effects on plant pollinator interactions, for example changing the foraging behaviour of pollinators. To date, the impact of plant population size on pollen collection by pollinators has not yet been investigated. From 2008 to 2010, we monitored nine bumble bee species (Bombus campestris, Bombus hortorum s.l., Bombus hypnorum, Bombus lapidarius, Bombus pascuorum, Bombus pratorum, Bombus soroensis, Bombus terrestris s.l., Bombus vestalis s.l.) on Vaccinium uliginosum (Ericaceae) in up to nine populations in Belgium ranging in size from 80 m2 to over 3.1 ha. Bumble bee abundance declined with decreasing plant population size, and especially the proportion of individuals of large bumble bee species diminished in smaller populations. The most remarkable and novel observation was that bumble bees seemed to switch foraging behaviour according to population size: while they collected both pollen and nectar in large populations, they largely neglected pollen collection in small populations. This pattern was due to large bumble bee species, which seem thus to be more likely to suffer from pollen shortages in smaller habitat fragments. Comparing pollen loads of bumble bees we found that fidelity to V. uliginosum pollen did not depend on plant population size but rather on the extent shrub cover and/or openness of the site. Bumble bees collected pollen only from three plant species (V. uliginosum, Sorbus aucuparia and Cytisus scoparius). We also did not discover any pollination limitation of V. uliginosum in small populations. We conclude that habitat fragmentation might not immediately threaten the pollination of V. uliginosum, nevertheless, it provides important nectar and pollen resources for bumble bees and declining populations of this plant could have negative effects for its pollinators. The finding that large bumble bee species abandon pollen collection when plant populations become small is of interest when considering plant and bumble bee conservation.