The lowland forest of Borneo is threatened by rapid logging for timber export and clearing for the expansion of timber and oil palm plantations. This combination of processes leaves behind landscapes dotted with small, often heavily-degraded forest fragments. The biodiversity value of such fragments, which are easily dismissed as worthless, is uncertain. We collected 187 taxa of rove beetles across a land-use gradient in Sabah, Malaysia, spanning pristine tropical lowland forest to heavily-degraded forest. Using these data, we identified shifts in alpha-, beta-, and gamma-diversity in response to forest quality and distance, then applied our findings from continuous expanses of forest to make predictions on hypothetical forest areas. We found that maintaining high forest quality is more important than forest area for conserving rare taxa (those important for conserving biodiversity per se), and that very small areas (10 ha) are likely to harbour the same richness of rove beetles as larger areas (100 ha) of equal forest quality. We estimate a decline in richness of 36% following heavy logging (removal of 95% of the vegetation biomass) from a forest area of 100 ha or less. Maintaining large forest area as well as high forest quality is important for conserving community composition, likely to be more important for conserving ecosystem functioning. We predict a decline of 35% in community diversity in conversion of a 100 ha area of unlogged forest to a 10 ha area of heavilylogged forest. Despite significant declines in alpha-diversity, beta-diversity within small rainforest areas may partially mitigate the loss of gamma-diversity, reinforcing the concept that beta-diversity is a dominant force determining the conservation of species in fragmented landscapes. In contrast to previous findings on larger animals, our results suggest that even small fragments of degraded forest might be important reservoirs of invertebrate biodiversity in tropical agriculture landscapes. These fragments, especially of lightly-logged forest, should be conserved where they occur and form an integral part of management for more sustainable agriculture in tropical landscapes.