This paper considers a multi-cell orthogonal frequency division multiple access (OFDMA) downlink system with several decode-and-forward (DF) relay stations (RSs) aiding the base station (BS) transmissions. The problem considered is the maximization of the system sum rate with a total power constraint in each cell. An iterative semi-distributed resource allocation (RA) algorithm is first proposed to optimize mode selection (decision whether relaying should be used or not and which relay), subcarrier assignment (MSSA), and power allocation (PA), alternatively. During the MSSA stage, the problem is decoupled into subproblems which can be solved distributively in linear time. During the PA stage, an algorithm based on single condensation and Lagrange duality (SCLD) is designed to optimize PA with the tentative MSSA results. The convergence of the SCLD-based RA algorithm is theoretically guaranteed and an local optimum is reached after convergence. To solve the formulated problem autonomously, a modified iterative water-filling (IWF) algorithm is further proposed. Specifically, each cell autonomously optimizes its own sum rate with the estimated power values of the received interferences from the other cells. An optimum algorithm is proposed to solve the local RA problem in each cell. Through numerical experiments, the convergence of the two proposed algorithms as well as their benefits compared with a centralized algorithm (CA) are illustrated.