Abstract-Many prediction studies using real life measurements such as wind speed, power, electricity load and rainfall utilize linear autoregressive moving average (ARMA) based models due to their simplicity and general character. However, most of the real life applications exhibit nonlinear character and modelling them with linear time series may become problematic. Among nonlinear ARMA models, polynomial ARMA (PARMA) models belong to the class of linear-in-the-parameters. In this paper, we propose a reversible jump Markov chain Monte Carlo (RJMCMC) based complete model estimation method which estimates PARMA models with all their parameters including the nonlinearity degree. The proposed method is unique in the manner of estimating the nonlinearity degree and all other model orders and model coefficients at the same time. Moreover, in this paper, RJMCMC has been examined in an anomalous way by performing transitions between linear and nonlinear model spaces.