Research on recycled concrete aggregates (RCAs) has been progressively advanced. Beyond replacing natural aggregates with RCA, discussions have been held on the effect of the parent concrete and repeatedly recycled aggregate concrete. Although it has been reported that RCA can be technically used for structural concrete, due to several other factors, RCA is mainly used for sub-bases. Therefore, identifying these factors is the key to promoting the use of RCA. Therefore, this review study first briefly summarizes the physical and chemical characteristics of RCA compared to natural aggregate, and reviews the effects of parent concrete and repeatedly recycled aggregate on next generation concrete. This study also briefly discusses the RCA standards of various countries and the factors that hinder the widespread use of RCA. The results show that there is a correlation in properties between parent concrete and the next generation concrete, and the properties of concrete decrease when RCA is used repeatedly. In addition, on the basis of the literature review, factors hindering the use of RCA were found to be unstable supply and demand, economic feasibility, and negative perceptions.