The perceptions of lightness or brightness elicited by a visual target are linked to its luminance by a nonlinear function that varies according to the physical characteristics of the target and the background on which it is presented. Although no generally accepted explanation of this scaling relationship exists, it has long been considered a byproduct of low-or mid-level visual processing. Here we examine the possibility that brightness scaling is actually the signature of a biological strategy for dealing with inevitably ambiguous visual stimuli, in which percepts of lightness͞brightness are determined by the probabilistic relationship between luminances in the image plane and their possible real-world sources.lightness ͉ luminance ͉ context T he relationship between the physical intensity of a light stimulus and its subjective perception has been debated since at least the middle of the 19th century (1-3). The central problem in ongoing attempts to rationalize this linkage has been the variability between luminance (i.e., the intensity of the light returned to the eye from object surfaces or light sources) and the sense of lightness or brightness elicited by the stimulus. Although intuition suggests that these sensations should scale in direct proportion to the intensity of the light that activates retinal receptors, the intensity of the sensation varies in a manner that is difficult to rationalize (Fig. 1). Thus, when targets are presented as luminance increments relative to a given background luminance, the scaling relationship is a power function referred to as Stevens' Law. Despite the canonical implication, the exponent of this function varies widely according to the size of the target, the duration of its presentation, the nature of the source, and other experimental variables (2, 4). Moreover, the relationship changes markedly and systematically as function of the intensity of the background luminance (6, 7). Although no consensus exists about the basis of these phenomena, many authors have interpreted them as consequences of neural processing early in the visual pathway (8-10).Although these effects are certainly initiated by low-and midlevel neural processing, the observed peculiarities of scaling may signify an important purpose. The possibility that we examine here is that the relationship between luminance and the resulting perceptions of lightness or brightness reflects a probabilistic strategy of visual processing demanded by the inherent ambiguity of visual stimuli. In these terms, the perceived intensity of any luminant stimulus is determined by the probability distribution of the possible underlying sources, or, more precisely, by the probable contributions of reflectance (R) and illumination (I) to the luminances experienced in the past (11). The amount of light associated with any part of a scene-that is, its local luminance-is typically the product of the I of that region and the R efficiency function(s) of the relevant object surfaces (12). In consequence, an infinite set of possible com...