Recently, a Rydberg atom-based mixer was developed to measure the phase of a radio frequency (RF) field. The phase of the signal RF (SIG RF) field is down-converted directly to the phase of a beat signal created by the presence of a local RF (LO RF) field. In this study, we propose that the Rydberg atom-based mixer can be converted to an all optical phase detector by amplitude modulation (AM) of the LO RF field; that is, the phase of the SIG RF field is related to both the amplitude and phase of the beat signal. When the AM frequency of the LO RF field is the same as the frequency of the beat signal, the beat signal will further interfere with the AM of the LO RF field inside the atom, and then the amplitude of the beat signal is related to the phase of the SIG RF field. The amplitude of the beat signal and the phase of the SIG RF field show a linear relationship within the range of 0 to π/2 when the phase of the AM is set with a difference π/4 from the phase of the LO RF field. The minimum phase resolution can be as small as 0.6 degree by optimizing the experimental conditions according to a simple theoretical model. This study will expand and contribute to the development of RF measurement devices based on Rydberg atoms.