The neurologist analyse the brain images to diagnose the disease via structure and shape of the part in the scanned Medical images such as CT, MRI, and PET.The Medical image segmentation perform less in the regions where no or little contrast,artefacts over the different boundary regions. The manual process of segmentation show poor boundary differentiation dueto discernibility in shape and location, intra and inter observer reliability. In this paper, we propose a dyadic Cat optimization (DCO) algorithm to segment the regions in the brain from CT and MRI image via Non- linear perspective Foreground and Back Ground projection. The DCO algorithm remove the artefacts in the boundary regions and provide the exact structure and shape of the brain regions. The DCO algorithm show the region boundary such as plerygomaxillary fissure, occipital lobe, vaginal process zygomatic arch, maxilla and piriform aperture with high visibility in the regions of inadequately visible boundary and distinguish the deformable shape. The DCO algorithm show the increased SSIM and 90 percent accuracy.