This paper investigates dynamic response, rutting resistance, and fatigue behavior of three stone mastic asphalt (SMA) concrete mixtures selected on basis of nominal maximum aggregate size (NMAS): 25 mm, 19 mm, and 12.5 mm using cellulose fiber added as 0.3% of the total weight of aggregate. Superpave gyratory specimens were fabricated and subjected to the dynamic modulus (E∗) and flow tests (flow number and flow time) using an asphalt mixture performance tester. The E∗ test results were employed to develop stress-dependent master curves for each mixture, indicating that the mixture with the NMAS of 25 mm is relatively stiffer than other tested mixtures; this mixture also exhibits excellent strength against rutting failure. In addition, fatigue parameter, which is derived from dynamic response and phase angle, is determined, and results reveal that 12.5 mm NMAS mix has relatively better resistance to fatigue than other selected mixtures. Furthermore, nonlinear regression model specifications were utilized to predict accumulated strains as a function of loading cycles. Also, a flow number model is developed that predicts the rutting behavior of mixtures, and results suggest that model predicted and observed outputs of 25 mm SMA mix are found to be very close. The results of this study help in understanding the performance and behavior of cellulose fiber-added stone mastic asphalt concrete mixtures under varying simulated temperature and stress levels, which can be used in areas where the premature failure of flexible pavements is often observed. The testing protocol employed in this study will also help in evaluating pavement performance using Mechanistic-Empirical Pavement Design Guide.