In this paper, we propose the interval-based Bayesian belief networks and then use them as the inference scheme in a. medical image recognition system. To integrate knowledges fron various sources, the blackboard architecture is used as the framework. The ProI)osed system consists of three phases. In phase one, three correlated images acquired from x-ray CT, proton density and T2-weighted MRI of a humaii brain are presented to the system. A signal-based segmentation algorithm is then employed to (livide each image into regions of homogeneous attributes. In phase two, the system tries to identify the major anatomica.l structures and locate the slice in the model that is most similar to the image set under study. To accomplish this work, one Bayesian belief network is constructed to integrate evidence from various sensor slices and the feature spaces for each anatomy and the other belief network is designed for opportunistic control in the blackboard system. In phase three, the selected model slice is used to guide the process of refining the recognized anatomies. 0-8194-1 138-8/93/$6.00 SPIE Vol. 1905 /615 Downloaded From: http://proceedings.spiedigitallibrary.org/ on 06/29/2016 Terms of Use: http://spiedigitallibrary.org/ss/TermsOfUse.aspx