Many researchers use fiber to improve the cracking resistance of asphalt mixtures, but research concerning the effects of fiber on fracture behavior is limited. The fracture behavior of asphalt mixtures with various fiber types (basalt fiber, glass fiber, and polyester fiber) and contents (0.1%, 0.2%, 0.3%, 0.4%, and 0.5%) has been studied using the indirect tensile asphalt cracking test (IDEAL-CT) in conjunction with digital image correlation (DIC) technology. The evaluation indexes used in the test included crack initiation energy (Gif), crack energy (Gf), splitting tensile strength (RT), cracking tolerance index (CTindex), and the real-time tensile strain (Exx) obtained using digital image correlation technology. The results showed that despite the fiber type, the increase of fiber content resulted in first, an increase, and then, a decrease of the cracking resistance of asphalt mixtures, indicating the presence of optimum fiber content—specifically, 0.4%, 0.3%, and 0.3% for basalt fiber, glass fiber, and polyester fiber, respectively. The development of real-time tensile strain, obtained based on digital image correlation technology, could be divided into two stages: slow-growth stage and rapid-expansion stage. In addition, asphalt mixture with basalt fiber presented the best cracking resistance at both the slow-growth and rapid-expansion stages. This research is helpful in understanding the effects of fiber type and content on the fracture behavior of asphalt mixtures and has certain reference significance for the application of fiber in asphalt mixtures.