In heterogeneous cellular networks (HCNs), the growing demand of small cell data traffic puts great pressure on the capacity limited backhaul links. Resource allocation is an efficient approach to mitigate the severe interference and improve the network performance in HCNs. However, differentiated backhaul capacity constraints introduce the inherent nonconvexity to the resource optimization problem, which hinders the development of the optimal solutions. In this article, we investigate the joint resource block (RB) and power allocation problem under two different backhaul capacity limitations. First, we consider the small cell backhaul limitation scenario where the backhaul capacity constraint is imposed on each small cell. Then, we extend the resource optimization to the macrocell base station backhaul limitation scenario which considers the overall backhaul capacity constraint on the whole small cell network. Besides, the quality of service (QoS) requirements of users and the cross‐tier interference mitigation are also considered. This resource allocation problem is formulated as a nonconvex mixed‐integer nonlinear programming (MINLP) problem. By variable substitution and constraints relaxation, we convert the original optimization problem into a convex one and obtain the optimal solutions. Accordingly, joint RB and power allocation algorithms are proposed. Numerical results verify the effectiveness of the proposed algorithms and evaluate the impact of different types of backhaul capacity limitations on system performance.