The introduction of numerous formulations of Ultra-high molecular weight polyethylene (UHMWPE), which is widely used as a bearing material in orthopedic implants, necessitated screening of bearing couples to identify promising iterations for expensive joint simulations. Pin-on-disk (POD) testers capable of multidirectional sliding can correctly rank formulations of UHMWPE with respect to their predictive in vivo wear behavior. However, there are still uncertainties regarding POD test parameters for facilitating clinically relevant wear mechanisms of UHMWPE. Studies on the development of POD testing were briefly summarized. We systematically reviewed wear rate data of UHMWPE generated by POD testers. To determine if POD testing was capable of correctly ranking bearings and if test parameters outlined in ASTM F732 enabled differentiation between wear behavior of various formulations, mean wear rates of non-irradiated, conventional (25–50 kGy) and highly crosslinked (≥90 kGy) UHMWPE were grouped and compared. The mean wear rates of non-irradiated, conventional and highly crosslinked UHMWPEs were 7.03, 5.39 and 0.67 mm3/MC. Based on studies that complied with the guidelines of ASTM F732, the mean wear rates of non-irradiated, conventional and highly crosslinked UHMWPEs were 0.32, 0.21 and 0.04 mm3/km, respectively. In both sets of results, the mean wear rate of highly crosslinked UHMPWE was smaller than both conventional and non-irradiated UHMWPEs (p<0.05). Thus, POD testers can compare highly crosslinked and conventional UHMWPEs despite different test parameters. Narrowing the allowable range for standardized test parameters could improve sensitivity of multi-axial testers in correctly ranking materials.