There are various differences in size, behavior, and life history traits of non-Apis bee species compared with honey bees (Apis mellifera; Linnaeus, 1758). Currently, the risk assessment for bees in the international and national process of authorizing plant protection products has been based on honey bee data as a surrogate organism for non-Apis bees. To evaluate the feasibility of a semifield tunnel test for Osmia bicornis (Linnaeus, 1758) and Osmia cornuta (Latreille, 1805), a protocol was developed by the non-Apis working group of the International Commission for Plant-Pollinator Relationships, consisting of experts from authorities, academia, and industry. A total of 25 studies were performed over a 2-yr period testing a replicated control against a replicated positive control using either a dimethoate or diflubenzuron treatment. Studies were regarded to be valid, if ≥30% of released females were found to occupy the nesting units in the night/morning before the application (establishment). Thirteen studies were regarded to be valid and were analyzed further. Parameters analyzed were nest occupation, flight activity, cell production (total and per female), cocoon production (total and per female), emergence success, sex ratio, and mean weight of females and males. Dimethoate was a reliable positive control at the tested rate of 75 g a.i./ha, once >30% females had established, displaying acute effects such as reduction in flight activity, increase in adult mortality (shown by nest occupation), and reproduction ability of the females (total cell and cocoon production). On the other hand, no effects on larval and pupal development were observed. The growth regulator diflubenzuron had statistically significant effects on brood development, causing mortality of eggs and larvae at a rate of approximately 200 g a.i./ha, whereas fenoxycarb did not cause any significant effects at the tested rates of 300 and 600 g a.i./ha. In conclusion, the ring-test protocol proved to be adequate once the study comprised a well-established population of female Osmia bees, and the results improved in the second year as the laboratories increased their experience with the test organism. It is noted that the success of This article includes online-only Supplemental Data. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.