We investigate how risk aversion affects the organizer's disclosing the actual number of bidders in an all‐pay auction with an exogenous bid cap and stochastic entry. With an exogenous probability of participation, the organizer prefers fully concealing the number of participating bidders when bidders are risk neutral. However, this result does not hold with risk aversion. Specifically, whether the organizer prefers fully concealing or fully revealing information depends on the number of potential bidders, the probability of participation, and the size of bid caps. A special case of endogenous entry shows that the organizer's preference is similar to the risk‐neutral case.