In the present object recognition study, we examined the relationship between brain activation and four behavioral measures: error rate, reaction time, observer sensitivity, and response bias. Subjects perceptually matched object pairs in which structural similarity (SS), an index of structural differentiation, and exposure duration (DUR), an index of task difficulty, were manipulated. The SS manipulation affected the fMRI signal in the left anterior fusiform and parietal cortices, which in turn reflected a bias to respond same. Conversely, an SS-modulated fMRI signal in the right middle frontal gyrus reflected a bias to respond different. The DUR manipulation affected the fMRI signal in occipital and posterior fusiform regions, which in turn reflected greater sensitivity, longer reaction times, and greater accuracy. These findings demonstrate that the regions most strongly implicated in processing object shape (SS-modulated regions) are associated with response bias, whereas regions that are not directly involved in shape processing are associated with successful recognition performance.