Breaking Into Language in a New Modality: The Role of Input and Individual Differences in Recognising Signs

Abstract

A key challenge when learning language in naturalistic circumstances is to extract linguistic information from a continuous stream of speech. This study investigates the predictors of such implicit learning among adults exposed to a new language in a new modality (a sign language). Sign-naïve participants (N = 93; British English speakers) were shown a 4-min weather forecast in Swedish Sign Language. Subsequently, we tested their ability to recognise 22 target sign forms that had been viewed in the forecast, amongst 44 distractor signs that had not been viewed. The target items differed in their occurrence frequency in the forecast and in their degree of iconicity. The results revealed that both frequency and iconicity facilitated recognition of target signs cumulatively. The adult mechanism for language learning thus operates similarly on sign and spoken languages as regards frequency, but also exploits modality-salient properties, for example iconicity for sign languages. Individual differences in cognitive skills and language learning background did not predict recognition. The properties of the input thus influenced adults’ language learning abilities at first exposure more than individual differences.

Which Aspects of Visual Motivation Aid the Implicit Learning of Signs at First Exposure?

“…Furthermore, the finding that iconicity was a predictor of performance in the exposure groups suggests that some degree of learning from the input materials was necessary for iconicity to play a role. The effect of iconicity is consistent with the findings of Hofweber et al (2022), where sign recognition was more accurate for highly iconic items. Those authors speculated that participants were endeavouring to construct meaning as they viewed the STS forecast, even though meaning per se was not tested by the recognition task.…”

“…However, the learning task is challenging, and whilst relying on visual motivation can be a successful strategy, it can also lead learners astray. The joint findings of the present study and those of Hofweber et al (2022) indicate that lexcical learning is possible from naturalistic input on first exposure to sign. The discoveries complement work on spoken languages and reveal that adult language-learning mechanisms can operate across modalities.…”

“…What our findings do show is that adults are able to learn form–meaning mappings on first exposure to a language, even when it occurs in a novel modality. Our findings also contribute to ongoing discussions in the field of second language acquisition about implicit learning at first exposure, which have hitherto been limited to spoken and written language (see Hofweber et al., 2022, for an overview).…”

“…Frequency and iconicity cumulatively facilitated participants’ recognition of target signs. Hofweber et al.’s (2022) findings extend those of Gullberg et al. (2010) from Mandarin Chinese to a sign language and suggest that the adult mechanism for implicit language learning might operate similarly for both signed and spoken languages as regards frequency, while also exploiting modality‐salient properties—in this case, iconicity.…”

“…The STS weather forecast used in the present study, and which we describe in detail in the Methods section, was also used in a recent study by Hofweber et al. (2022). In that study, participants undertook a sign recognition task immediately after they had viewed the forecast.…”