Path planning and tracking control is an essential part of autonomous vehicle research. In terms of path planning, the artificial potential field (APF) algorithm has attracted much attention due to its completeness. However, it has many limitations, such as local minima, unreachable targets, and inadequate safety. This study proposes an improved APF algorithm that addresses these issues. Firstly, a repulsion field action area is designed to consider the velocity of the nearest obstacle. Secondly, a road repulsion field is introduced to ensure the safety of the vehicle while driving. Thirdly, the distance factor between the target point and the virtual sub-target point is established to facilitate smooth driving and parking. Fourthly, a velocity repulsion field is created to avoid collisions. Finally, these repulsive fields are merged to derive a new formula, which facilitates the planning of a route that aligns with the structured road. After path planning, a cubic B-spline path optimization method is proposed to optimize the path obtained using the improved APF algorithm. In terms of path tracking, an improved sliding mode controller is designed. This controller integrates lateral and heading errors, improves the sliding mode function, and enhances the accuracy of path tracking. The MATLAB platform is used to verify the effectiveness of the improved APF algorithm. The results demonstrate that it effectively plans a path that considers car kinematics, resulting in smaller and more continuous heading angles and curvatures compared with general APF planning. In a tracking control experiment conducted on the Carsim–Simulink platform, the lateral error of the vehicle is controlled within 0.06 m at both high and low speeds, and the yaw angle error is controlled within 0.3 rad. These results validate the traceability of the improved APF method proposed in this study and the high tracking accuracy of the controller.