This study reviewed 28 research papers published in The Japanese Journal of Educational Psychology, from issue 3 of volume 69 to issue 2 of volume 70, to assess new research practices such as pre-registration, the use of the Open Science Framework, and statistical methods, including Bayesian methods. The results indicated that these new research practices were not pervasive in the journal. We also discussed new research practices and statistical methods from the severe testing perspective. In addition, a confidence curve was explained to visualize the results of statistical hypothesis testing. Finally, based on the insights from our results, several approaches were proposed to improve these new research practices and statistical analyses.