The key to evaluating the health status of cable-stayed bridges lies in the accuracy of cable force measurement. When measuring the cable force using the conventional frequency method, the clearance between the bracing cable and the protective tube is typically disregarded. Moreover, due to their large size, existing vibration sensors are difficult to install into protective tubes for steel strand-type bracing cables to measure the cable force. To address the above difficulties, a type of thin rod vibration sensor only 5 mm in diameter was designed based on the high sensitivity of Fiber Bragg grating (FBG), and high-throughput data processing software for engineering calculation (EC) was self-developed. Then, the recognition principle of the thin rod vibration sensor was theoretically analyzed and a step-by-step tension test was carried out. The results demonstrated that the relative error of the cable force measured by the thin rod vibration sensor within 12.865 Hz was less than 5% and the sensitivity reached 28.7 pm/Hz, indicating its high measurement precision. Upon subsequent application of the thin rod vibration sensor to a monitoring test in the field, the relative error of the fundamental frequency between artificial and natural excitations was less than 4%. In addition, the error relative to both the theoretical frequency and the third-party sampling frequency was less than 5%, further verifying the accuracy and applicability for monitoring the cable force of bridges under natural excitation. Compared with the traditional cantilever FBG sensor, the improved sensor with supporting data processing software has the advantages of small cross-section, high reliability, and good sensitivity. The research results can provide a reference for the subsequent accurate measurement of cable force and the development of a supporting sensor data processing system.