Relaying is a convenient way to provide full coverage in cellular networks. In particular, small relay cells can be used as a cost-effective solution for indoor coverage in MIMO-OFDM systems. The small relay cells would need to cater for indoor users' quality of service (QoS) expectations. One key QoS objective is delivering stable data rates for multimedia applications, which we refer to as guaranteed data rates. In this article, we consider optimization for delivering guaranteed data rates in a network with multiple relays and a macro base station, in a scenario when there are both macro users and relay users to be served. A novel scheme called cell-guaranteed bit rate by relay scheduling is proposed, with both optimal and heuristic scheduling methods. To perform the optimization we exploit resource block allocation, and parameters such as relaying duration and relay bandwidth allocation. Interference between relays and macro is avoided through time domain orthogonalization. Another key aspect of the scheme is inter-frame scheduling, wherein relay feeder links can be flexibly scheduled in any time slot along with macro users. Performance evaluation is presented using real-time indoor measurement channels and a sample test scenario. Results show the heuristic method can improve performance by 89.47% as compared to round-robin scheduling at relays and is within a 5% gap to optimal scheduling.