Childhood infections have been shown to stunt growth, contribute to malnutrition and reduce cognition in early adulthood. This study aimed to assess relationships between early life infections and childhood cognition at age 11 years in the Newcastle Thousand Families Study (NTFS). The analysis included 741 members from the NTFS who had complete data for infections between birth and 5 years, and the 11-plus examinations. School records from the 11-plus examinations showed cognitive (IQ), English (EQ) and arithmetic (AQ) abilities. Housing conditions, overcrowding, birth order and social class were recorded at birth. Helicobacter pylori seropositivity was measured at age 49–51 years. Multivariable linear regression was used to examine relationships between infections and cognition. The total number of infections in the first 5 years of life was not significantly associated with IQ, EQ or AQ, nor were there significant relationships between cognitive outcomes and most infections. Tonsillitis did display a positive, significant association with IQ after adjustment for confounders (b = 6.43, 95% CI 0.92, 11.94, p = 0.022). Lower respiratory tract infections (LRTIs) showed significant negative relationships with all cognitive outcomes. H. pylori seropositivity at age 50 exhibited negative, significant relationships with EQ (p = 0.014) and AQ (p = 0.024) after adjustment for confounders. Although no significant relationship between overall infections and cognition were found, there were indications that LRTIs and gastrointestinal system infections may limit cognitive development. Given these infections remain prevalent, further research regarding severity and recurrence of infections and how they affect childhood cognition is needed.