“…This truncation is necessary for identification purposes, and rests on the relatively safe assumption that experts code in the right direction. Note that the model also accounts for systematic biases in how experts translate perceptions into ratings-a common concern in surveys that rely on multi-rater judgment (Aldrich and McKelvey, 1977;Bakker et al, 2014;Hare et al, 2015)-through γ, a k = 1, ..., n vector of threshold parameters specific to each expert. As a result, β estimates the degree to which experts stochastically diverge from other experts who coded the same cases, conditional on her scale perception.…”