Designing complex concentrated alloys (CCA), also known as high entropy alloys (HEA), requires reliable and accessible thermodynamic predictions due to vast space of possible compositions. Numerous semiempirical parameters have been developed for phase predictions over the years. However, in this paper we show that none of these parameters is a robust indicator of phase content in various refractory CCA. CALPHAD proved to be a more powerful tool for phase predictions, however, the predictions face several limitations. AlTiNbMoV, AlTiNbTaZr and AlTiNbMoCr alloys were prepared using blended elemental powder metallurgy. Their phase and chemical composition were investigated by the means of scanning electron microscopy, energy-dispersive X-ray spectroscopy and X-ray diffraction. Apart from the minor contamination phases (Al2O3 and Ti(C,N,O)), AlTiNbMoV and AlTiNbMoCr exhibited single-phase solid solution microstructure at the homogenization temperature of 1400 °C, while Al3Zr5 based intermetallics were present in the AlTiNbTaZr alloy. None of the simple semiempirical parameter was able to predict phase content correctly in all three alloys. Predictions by CALPHAD (TCHEA4 database) were able to predict the phases with limited accuracy only. Critical limitation of the TCHEA4 database is that only binary and ternary phase diagrams are assessed and some more complex phases cannot be predicted.