Anxieties that are specific to a particular kind of thinking have been demonstrated for a variety of cognitive domains. One hypothesized consequence of these anxieties is reduced interest in pursuing activities and, consequentially, careers that involve the type of thinking in question in an effort to avoid engaging in that type of thinking. There is little research addressing this avoidance hypothesis, possibly because it is difficult to categorize pursuits as objectively “creative” or “spatial”. Here, we measured the perceptions that participants, themselves, hold about how much pursuits (careers and activities) involve different types of thinking. We developed a novel framework for calculating “affinity coefficients”, within-person associations between perceived cognitive involvement and interest across several pursuits. Having a negative creative affinity coefficient, for instance, means being less interested in pursuits the more they are perceived as involving creative thinking. Results across three separate cognitive domains (creativity, mathematics, and spatial reasoning) reliably showed that higher anxiety in a domain uniquely predicted a lower affinity coefficient in that domain, providing consistent evidence of avoidance tendencies linked to cognition-specific anxieties. These findings suggest that feeling anxious about particular types of thinking may play a significant role in shaping our interests, both big and small.