SUMMARYIn this paper, we study the resource allocation problem of the uplink transmission with delay quality-ofservice constraints in two-tier femtocell networks. Particularly, to provide statistical delay guarantees, the effective capacity is employed as the network performance measure instead of the conventional Shannon capacity. To make the problem computationally efficient and numerically tractable, we decompose the problem into three subproblems, namely, cluster configuration subproblem, intra-cluster subchannel allocation subproblem and inter-cluster power control subproblem. Firstly, we develop a low-complexity heuristic semi-dynamic clustering scheme, where the delay of the channel state information feedback via backhaul is considered. We model such system in the framework of networked partial observation Markov decision process and derive a strategy to reduce the search range for the best cluster configuration. Then, for a given cluster configuration, the cluster heads deal with subchannel allocation and power control within each cluster. We propose a subchannel allocation scheme with proportional fairness. Thereafter, the inter-cluster power control subproblem is modeled as a set of exact potential games, and a channel quality related pricing mechanism is presented to mitigate inter-cluster interference. The existence and uniqueness of Nash equilibriums for the proposed game are investigated, and an effective decentralized algorithm with guaranteed convergence is designed. Simulation results demonstrate that the proposed algorithms not only have much lower computational complexity but also perform close to the exhaustive search solutions and other existing schemes.