Chimeric antigen receptor (CAR) cell therapy has achieved groundbreaking success in treating hematological malignancies. However, its application to solid tumors remains challenging due to complex manufacturing processes, limited in vivo persistence, and transient therapeutic effects. In vivo CAR-immune cells induced by gene delivery systems loaded with CAR genes and gene-editing tools have shown efficiency for anti-tumor immunotherapy. In situ programming of autologous immune cells avoids the safety concerns of allogeneic immune cells, and the manufacture of gene delivery systems could be standardized. Therefore, the in vivo editing and in situ generation of CAR-immune cells might potentially overcome the abovementioned limitations of current CAR cell therapy. This review mainly focuses on CAR structures, gene-editing tools, and gene delivery techniques applied in anti-tumor immunotherapy to help design and develop in situ CAR-immune cell therapy. The recent applications of in vivo CAR-immune cell therapy in both hematologic malignancies and solid tumors are investigated. To sum up, the in vivo editing and in situ generation of CAR therapy holds promise for offering a practical, cost-effective, efficient, safe, and widely applicable approach to the next-generation anti-tumor immunotherapy.