The rhombus structure of small aluminum‐oxygen clusters anions, A12Ox− (x=2−5), were constructed using high‐accuracy quantum chemical calculations. Of the presented DFT‐D methods, M05‐2X, M06‐2X, and ωB97X‐D functionals are comparable to MP2 level to perform well for determination of the properties of the anionic clusters. The rhombus‐type Al2O2− cluster has a desired D2h cyclic structural view. The most favored Al2O3− isomer is evolved from the D2h cyclic Al2O2− structure generated by adding the third O atom to the Al atom. The Al2O4− with rhombus structure probably has two coexist low‐lying isomers, one symmetric D2h and the other C2v “twisted pair”, and stability of the former is in preference over that of the latter. The most probable Al2O5− structure would be made by replacing a terminal O atom of the symmetric D2h A12O4− with an O2 unit. Consequently, structures of the most stable anionic clusters possess a rhombus character. Moreover, our findings also suggest that the more oxygen atoms the anionic cluster has, the more stable the structure is, and the stronger the H2O effect is. Beyond that, for the identified cluster anion with same degree of oxidation the symmetric structure becomes more stable with respect to the asymmetric analog, however, the H2O effect on the asymmetric geometry turns out to be predominant, in comparison with the symmetric case.