This article traces the characteristics, origin, distribution, and function of alternative lateral horse gaits, i.e., intermediate speed lateral-sequence gaits. Such alternative lateral gaits (running walk, rack, broken pace, hard pace, and broken trot) are prized by equestrians today for their comfort and have been found in select horse breeds for hundreds of years and even exhibited in fossil equid trackways. After exploring the evolution and development of alternative lateral gaits via fossil equid trackways, human art, and historical writings, the functional and genetic factors that led to the genesis of these gaits are discussed. Such gaited breeds were particularly favored and spread by the Scythians, Celts, Turks, and Spaniards. Fast and low-swinging hard pacing gaits are common in several horse breeds of mountainous areas of East and North Asia; high-stepping rack and running walk gaits are often displayed in European and North and South American breeds; the broken pace is found in breeds of Central Asia, Southeast Asia, West Asia, Western North America, and Brazil in South America; and the broken trot occurs in breeds of North Asia, South Asia, the Southern United States, and Brazil in South America, inhabiting desert or marshy areas.