Abstract-The primary objective of this study is to perform a blinded evaluation of two groups of retrospective image registration techniques, using as a gold standard a prospective markerbased registration method, and to compare the performance of one group with the other. These techniques have already been evaluated individually [27]. In this paper, however, we find that by grouping the techniques as volume based or surface based, we can make some interesting conclusions which were not visible in the earlier study. In order to ensure blindness, all retrospective registrations were performed by participants who had no knowledge of the gold-standard results until after their results had been submitted. Image volumes of three modalities: X-ray computed tomography (CT), magnetic resonance (MR), and positron emission tomography (PET) were obtained from patients undergoing neurosurgery at Vanderbilt University Medical Center on whom bone-implanted fiducial markers were mounted. These volumes had all traces of the markers removed and were provided via the Internet to project collaborators outside Vanderbilt, who then performed retrospective registrations on the volumes, calculating transformations from CT to MR and/or from PET to MR. These investigators communicated their transformations, again via the Internet, to Vanderbilt, where the accuracy of each registration was evaluated. In this evaluation, the accuracy is measured at multiple volumes of interest (VOI's). Our results indicate that the volume-based techniques in this study tended to give substantially more accurate and reliable results than the surface-based ones for the CT-to-MR registration tasks, and slightly more accurate results for the PET-to-MR tasks. Analysis of these results revealed that the rotational component of error was more pronounced for the surface-based group. It was also apparent that all of the registration techniques we examined have the potential to produce satisfactory results much of the time, but that visual inspection is necessary to guard against large errors.Index Terms-Computed tomography, image registration, magnetic resonance, positron emission tomography, surfacebased versus volume-based.