Abstract-In recent past, the current Internet architecture has many challenges in supporting the magnificent network traffic. Among the various that affect the quality of communication in the massive architecture the challenge in maintaining congestion free flow of traffic is one of the major concerns. In this paper, we propose a novel technique to address this issue using cross layer paradigm based on stochastic approach with extended markovian model. The cross layer approach will bridge the physical layer, link layer, network layer and transport layer to control congestion. The resource provisioning operation will be carried out over link layer and the mechanism of exploring the congestion using stochastic approach will be implemented over the network layer. The Markov modeling is adopted to identify the best routes amidst of highly congested paths and it is carried out at the transport layer. An analytical research methodology will be adopted to prove that it is feasible to develop a technique that can identify the origination point of congestion and share the same with the entire network. It is found that this approach for congestion control is effective with respect to end to end delay, packet delivery ratio and processing time.