The quantity of organic waste generated by agricultural sectors is continually increasing due to population growth and rising food demand. Rice is the primary consumable food in Asia. However, many stakeholders follow a linear economic model such as the “take–make–waste” concept. This linear model leads to a substantial environmental burden and the destruction of valuable resources without gaining their actual value. Because these by-products can be converted into energy generating and storage materials, and into bio-based products by cascading transformation processes within the circular economy concept, waste should be considered a central material. This review examines the composition of rice straw, bran, and husks, and the procedures involved in manufacturing value-added goods, from these wastes. Moreover, starting with an extensive literature analysis on the rice value chains, this work systematizes and displays a variety of strategies for using these by-products. The future development of agricultural waste management is desirable to capitalize on the multi-functional product by circulating all the by-products in the economy. According to the analysis of relevant research, rice straw has considerable potential as a renewable energy source. However, there is a significant research gap in using rice bran as an energy storage material. Additionally, modified rice husk has increased its promise as an adsorbent in the bio-based water treatment industry. Furthermore, the case study of Sri Lanka revealed that developing countries have a huge potential to value these by-products in various sectors of the economy. Finally, this paper provides suggestions for researchers and policymakers to improve the current agriculture waste management system with the best option and integrated approach for economic sustainability and eco- and environmental solution, considering some case studies to develop sustainable waste management processes.