Tracking skeletal muscle architecture using B-mode ultra-sound is a widely used method in the field of human movement science and biomechanics. Sequential methods based on optical flow algorithms allow for smooth and coherent muscle tracking but are known to drift over time. Non-sequential feature detection methods on the other hand, do not suffer from drift, but are limited to tracking only lower-dimensional features. They are also known to be sensitive to image noise, and therefore often result in highly irregular tracking patterns. Building on the complimentary nature of both approaches, we present a novel fully automated hybrid muscle tracking approach that combines a sequential feature-point tracking method and a non-sequential method based on Hough transform. Tibialis anterior fascicle pennation angle and length, and central aponeurosis displacement, were measured in five healthy individuals during isometric contractions at five different ankle angles. Our hybrid method was demonstrated to significantly (p < 0.001) reduce drift compared to two sequential methods, and curve irregularity was significantly (p < 0.001) decreased compared to a non-sequential method. These findings suggest that the proposed hybrid approach can uniquely mitigate drift and irregularity limitation of individual methods used for tracking skeletal muscle architecture. Fully automated muscle tracking allows for convenient analysis of large datasets, whereas automatic drift correction opens the door for tracking muscle architecture in long ultrasound recordings during common movements, such as walking, running, and jumping without the need for manual intervention.