There is a vast array of new and improved methods for comparing groups and studying associations that offer the potential for substantially increasing power, providing improved control over the probability of false positives, and yielding a deeper and more nuanced understanding of data. These new techniques effectively deal with four insights into when and why conventional methods can be unsatisfactory. But for the non-statistician, this vast array of techniques for comparing groups and studying associations can seem daunting. This article briefly reviews when and why conventional methods can have relatively low power and yield misleading results. The main goal is to suggest guidelines regarding the use of modern techniques that improve upon classic approaches such as Pearson's correlation, ordinary linear regression, ANOVA, and ANCOVA. This updated version includes recent advances dealing with effect sizes, including situations where there is a covariate. The R code, figures, and accompanying notebooks have been updated as well.