Tumors in the human prostate are usually stiffer compared to surrounding non-malignant glandular tissue, and tactile resonance sensors measuring stiffness can be used to detect prostate cancer. To explore this further, we used a tactile resonance sensor system combined with a rotatable sample holder where whole surgically removed prostates could be attached to detect tumors on, and beneath, the surface ex vivo. Model studies on tissue phantoms made of silicone and porcine tissue were performed. Finally, two resected human prostate glands were studied. Embedded stiff silicone inclusions placed 4 mm under the surface could be detected in both the silicone and biological tissue models, with a sensor indentation of 0.6 mm. Areas with different amounts of prostate cancer (PCa) could be distinguished from normal tissue (p < 0.05), when the tumor was located in the anterior part, whereas small tumors located in the dorsal aspect were undetected. The study indicates that PCa may be detected in a whole resected prostate with an uneven surface and through its capsule. This is promising for the development of a clinically useful instrument to detect prostate cancer during surgery.