In this paper, the robust stability of interval fractional order plants with one time delay controlled by fractional order controllers is investigated in a general form. For robust stability analysis of the closed loop system by the zero exclusion principle, the distance between the origin and the value set of the characteristic function needs to be checked. It is known that the outer vertices of this value set may change at some switching frequencies and the repetitive calculation of these vertices at switching frequencies leads to additional calculations. In this study initially, new necessary and sufficient conditions are proposed to check the robust stability of a delayed fractional order closed loop system. Then, a novel robust stability testing function is presented based on some vertices, which are fixed for all positive frequencies. Therefore, no additional calculation is needed to obtain the outer vertices of the characteristic function value set for any pair of the switching frequencies. Also, a finite frequency range is presented to reduce the computational cost noticeably. Eventually, three numerical examples are given to verify the efficiency of the results of this paper.