The purpose of this study was to assess the accuracy of clinical and laboratory measures of directional microphone benefit. Three methods of simulating a noisy restaurant listening situation ([1] a multimicrophone/multiloudspeaker simulation, the R-SPACE, [2] a single noise source behind the listener, and [3] a single noise source above the listener) were evaluated and compared to the "live" condition. Performance with three directional microphone systems differing in polar pattern (omnidirectional, supercardioid, and hypercardioid array) and directivity indices (0.34, 4.20, and 7.71) was assessed using a modified version of the Hearing in Noise Test (HINT). The evaluation revealed that the three microphones could be ordered with regard to the benefit obtained using any of the simulation techniques. However, the absolute performance obtained with each microphone type differed among simulations. Only the R-SPACE simulation yielded accurate estimates of the absolute performance of all three microphones in the live condition. Performance in the R-SPACE condition was not significantly different from performance in the "live restaurant" condition. Neither of the single noise source simulations provided accurate predictions of real-world (live) performance for all three microphones.