Contrast is an imperative perceptible attribute embodying the image quality. In medical images, the poor quality, specifically low contrast inhibits precise interpretation of the image. Contrast enhancement is, therefore, applied not merely to improve the visual quality of images but also enabling them to facilitate further processing tasks. In this paper, we propose a contrast enhancement approach based on cross-modal learning using two-way Generative Adversarial Network (GAN), where U-Net augmented with global features acts as a generator. Besides, individual batch normalization has been used to make generators adapt specifically to their input distributions. The proposed method learns the global contrast characteristics of T1-w brain magnetic resonance images (MRI) to improve the contrast of T2-w images. The experiments were conducted on a publicly available IXI dataset. Comparison with recent CE methods and quantitative assessment using two prevalent metrics FSIM and BRISQUE validate the superior performance of the proposed method.