Why Do Online Product Reviews Have a J-Shaped Distribution? Overcoming Biases in Online Word-of-Mouth Communication

Abstract

Online word-of-mouth communication in the form of product reviews is a major information source for consumers and marketers about product quality. The literature has used the mean of online reviews to predict product sales, assuming that the mean reflects product quality. However, using a combination of econometric, experimental, and analytical results, we show that the mean is a biased estimator of product quality due to two self-selection biases (purchasing and under-reporting bias). First, econometric results with secondary data from Amazon.com show that almost all products have an asymmetric bimodal (J-shaped) distribution with more positive than negative reviews. Second, experimental results where all respondents wrote reviews show that their reviews have an approximately normal distribution with roughly equal number of positive and negative reviews.This implies two biases: (1) purchasing bias -only consumers with favorable disposition towards a product purchase the product and have the opportunity to write a product review, and (2) under-reporting biasconsumers with polarized (either positive or negative) reviews are more likely to report their reviews than consumers with moderate reviews. This results in a J-shaped distribution of online product reviews that renders the mean a biased estimator of product quality. Third, we develop an analytical model to derive the conditions for the mean to become an unbiased estimator of product quality. Based on these conditions, we build a new model that integrates three distributional parameters -mean, standard deviation, and the two modes of the online product reviews (to overcome under-reporting bias) and product price (to overcome purchasing bias). This model is shown to be a superior predictive model of future product sales compared to competing models.

Is Tom Cruise Threatened? An Empirical Study of the Impact of Product Variety on Demand Concentration

“…In our own data, we find a correlation of about 0.5 between the monthly number of ratings and the rental turns among the matched movies. Second, unlike other review data that are known to have selection bias because users tend to review items they extremely like or dislike (see Hu et al 2007;Dellarocas and Narayan 2007;Dellarocas and Wood 2008 and citations therein), pure ratings may avoid this bias because giving a rating is much less costly to a user than writing a review. In our data, we plot the histogram of the rating values on a scale from one to five and find the rating of four to be the most frequent, followed by the ratings of three, five, two and one.…”

Why watching movie tweets won't tell the whole story?

“…Analyzing the impact of these positive and negative online reviews is an important topic for both networking and marketing communities. Product ratings on sites like Amazon typically have a large number of very high and very low scores, which create J -shaped histograms over the rating scale [6]. This is attributed to the "brag-and-moan" phenomenon among reviewers.…”

“…IMDb and Rotten Tomatoes' user ratings 6 are often used as a predictors of a movie's quality and box-office potential. With the ready availability of OSN user opinion as poll data, researchers have proposed using pre- 6 For a fair comparison, we exclude scores from movie critics.…”

“…With the ready availability of OSN user opinion as poll data, researchers have proposed using pre- 6 For a fair comparison, we exclude scores from movie critics.…”

Deriving the Pricing Power of Product Features by Mining Consumer Reviews

“…Consequently, (Li and Hitt 2008) suggest that consumer-generated product reviews may not be an unbiased indication of unobserved product quality. Further, recent work has shown that the distribution of an overwhelming majority of reviews posted in online markets is bimodal (Hu et al 2008). In such situations, the average numerical star rating assigned to a product may not convey a lot of information to a prospective buyer.…”