The well‐known Markowitz approach to portfolio allocation, based on expected returns and their covariance, seems to provide questionable results in financial management. One motivation for the pitfall is that financial returns have heavier than Gaussian tails, so the covariance of returns, used in the Markowitz model as a measure of portfolio risk, is likely to provide a loose quantification of the effective risk. Additionally, the Markowitz approach is very sensitive to small changes in either the expected returns or their correlation, often leading to irrelevant portfolio allocations. More recent allocation techniques are based on alternative risk measures, such as value at risk (VaR) and conditional VaR (CVaR), which are believed to be more accurate measures of risk for fat‐tailed distributions. Nevertheless, both VaR and CVaR estimates can be influenced by the presence of extreme returns. In this paper, we discuss sensitivity to the presence of extreme returns and outliers when optimizing the allocation, under the constraint of keeping CVaR to a minimum. A robust and efficient approach, based on the forward search, is suggested. A Monte Carlo simulation study shows the advantages of the proposed approach, which outperforms both robust and nonrobust alternatives under a variety of specifications. The performance of the method is also thoroughly evaluated with an application to a set of US stocks.