Spiders are among the animals evoking the highest fear and disgust and such a complex response might have been formed throughout human evolution. Ironically, most spiders do not present a serious threat, so the evolutionary explanation remains questionable. We suggest that other chelicerates, such as scorpions, have been potentially important in the formation and fixation of the spider-like category. In this eye-tracking study, we focused on the attentional, behavioral, and emotional response to images of spiders, scorpions, snakes, and crabs used as task-irrelevant distractors. Results show that spider-fearful subjects were selectively distracted by images of spiders and crabs. Interestingly, these stimuli were not rated as eliciting high fear contrary to the other animals. We hypothesize that spider-fearful participants might have mistaken crabs for spiders based on their shared physical characteristics. In contrast, subjects with no fear of spiders were the most distracted by snakes and scorpions which supports the view that scorpions as well as snakes are prioritized evolutionary relevant stimuli. We also found that the reaction time increased systematically with increasing subjective fear of spiders only when using spiders (and crabs to some extent) but not snakes and scorpions as distractors. The maximal pupil response covered not only the attentional and cognitive response but was also tightly correlated with the fear ratings of the picture stimuli. However, participants’ fear of spiders did not affect individual reactions to scorpions measured by the maximal pupil response. We conclude that scorpions are evolutionary fear-relevant stimuli, however, the generalization between scorpions and spiders was not supported in spider-fearful participants. This result might be important for a better understanding of the evolution of spider phobia.