Information‐Centric Networking (ICN) has been widely applied into different fields, such as 5G, big data and new networking structures. This paper pays attention to the improvement of physical education, realizing the high‐performance online physical education based on Artificial Intelligence (AI). Currently, the online physical education is faced with a serious challenge, that is, the standard of smart video delivery cannot be reached, which causes that the physical learning effect of students through video has not been developed and approved well. In this paper, the physical education video is deployed at ICN structure. Then, based on ICN, this paper makes a video delivery ‐based case study for the online physical education optimization, where Reinforcement Learning (RL) is used for transmission optimization of video. Finally, this paper makes a simulation in terms of the proposed physical education optimization scheme, and the results demonstrate its feasibility and efficiency.