This study examines the new Booking.com rating system, which has suffered a significant drop in scores awarded to accommodation. We aim to determine the extent of these declines and identify the factors that make them more pronounced in some hotels than in others. Our findings reveal a consistent, much more significant drop in scores than reflected in recently published studies that minimized the effects of the changes. Contrary to the predictions made in other studies, the highest-rated hotels have also suffered drops in their scores. Machine learning models identified “facilities” as the item that plays the most relevant role in consumers’ global satisfaction and contributes to predicting the magnitude of drops in scores with the new system. Implications for both hoteliers and academics utilizing Booking.com’s score data are identified, particularly for studies comparing data from different periods.