In this paper, TA-ARQ (Time-constrained Aggregated Automatic Repeat-reQuest) with an adaptive rate control for SVC streaming based on UDP transport protocol is proposed. To meet the requirement of terminal equipment in the heterogeneous network environments, we consider SVC for different applications. Selected NALUs (Network Abstraction Layer Units) are sent according to the quality estimation of scalable video coding in the server. Moreover, a retransmission mechanism is adopted to reduce loading of the aggregated ARQ retransmissions in multimedia networks and enhance the quality of video streaming. Based on the evaluation of NALU quantity and display order, the priority of each unit is determined. In transmission of SVC sequences, the server can extract different transmission packets, especially for retransmitting lost data. The experimental results show that the bandwidth utilization ratio of the proposed scheme can be up to 91.25% compared with decoding-order-based decision when the theoretical bandwidth is 5 Mbps. In advance, the proposed scheme with TA-ARQ can have quality gain about 0.4 dB in the unicast receiver.