Although previous work has shown that some speech sounds contain more speaker-dependent information than others, not much is known about the speaker information of the same segment in different linguistic contexts. The present study therefore investigated whether Dutch fricatives /s/ and /x/ from telephone dialogues contain differential speaker information as a function of syllabic position and labial co-articulation. These linguistic effects, established in earlier work on read broadband speech, were firstly investigated. Using a corpus of Dutch telephone speech, results showed that the telephone bandwidth captures the expected effects of perseverative and anticipatory labialization for back fricative /x/, for which spectral peaks fall within the telephone band, but not for front fricative /s/, for which the spectral peak falls outside the telephone band.Multinomial logistic regression shows that /s/ contains slightly more speaker information than /x/ in telephone speech and that speaker information is distributed across the speech signal in a systematic way; even though differences in classification accuracy were small, for both /s/ and /x/, codas and tokens with labial neighbours are more speaker-specific than onsets and tokens with non-labial neighbours. These findings indicate that speaker information contained by the same speech sound is not the same across contexts.