Visual World Paradigm Data: From Preprocessing to Nonlinear Time-Course Analysis

Porretta, Vincent; Kyröläinen, Aki-Juhani; Rij, Jacolien van; Järvikivi, Juhani

doi:10.1007/978-3-319-59424-8_25

Cited by 42 publications

(54 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Finally, GAMMs can handle unbalanced data (i.e., missing data points), which is common in eye tracking as participants are free to fixate outside of the predetermined interest areas during a trial. GAMMs have successfully been used in past research to analyze visual world eye movements (Porretta, Kyrölaïnen, van Rij, & Järvikivi, 2017;Porretta, Tucker, & Järvikivi, 2016; van Rij, Hollebrandse, & Hendriks, 2016). Also note that GAMMs require visual inspection of model estimates to interpret (non-)significance of factors, especially since Bnonlinear trends are difficult to capture with a single parameter ( Porretta et al, 2017, p. 270).…”

Section: Analysis and Variablesmentioning

confidence: 99%

Gradient and categorical patterns of spoken-word recognition and processing of phonetic details

Desmeules-Trudel

Zamuner

2019

Atten Percept Psychophys

View full text Add to dashboard Cite

The speech signal is inherently rich, and this reflects complexities of speech articulation. During spoken-word recognition, listeners must process time-dependent perceptual cues, and the role that these cues play varies depending on the phonological status of the sounds across languages. For example, Canadian French has both phonologically nasal vowels (i.e., contrastive) and coarticulatorily nasalized vowels, as opposed to English, which only has coarticulatorily nasalized vowels. We investigated how vowel nasalization duration, a time-dependent phonetic cue to the French nasal contrast, affects spoken-word recognition. Using eye tracking in two visual world paradigm experiments, the results show that fine-grained phonetic information is important for lexical recognition, and that lexical access is dependent on small variations in the signal. The results also show gradient interpretation of ambiguous vowel nasalization despite the phonemic distinction between phonological nasal vowels and coarticulatorily nasalized vowels in Canadian French. Gradience was found when words were ambiguous, and interpretation was more categorical when words were unambiguous. These results support the hypothesis of gradient interpretation of phonetic cues for ambiguously produced stimuli and the storage of coarticulatory information in phono-lexical representations for a language that has a phonological contrast for nasality (i.e., French).Keywords Eye tracking . Coarticulation processing . Vowel nasalization . Gradience . Spoken-word recognition During speech processing, listeners are presented with timedependent and variable, fine-grained acoustic cues for phoneme and word recognition. These cues include within-category variability and coarticulation, which is the result of the overlap of adjacent sounds' articulatory movements (Fowler, 1980). These cues were traditionally considered redundant for formal theories of phonetic, phonological, and lexical representations (

show abstract

Section: Analysis and Variablesmentioning

confidence: 99%

Gradient and categorical patterns of spoken-word recognition and processing of phonetic details

Desmeules-Trudel

Zamuner

2019

Atten Percept Psychophys

View full text Add to dashboard Cite

show abstract

“…% fixations = duration of fixations to target duration of fixations to competitor + duration of fixation to target The data were statistically analyzed using generalized additive mixed models (GAMMs; Wood, 2017), which can account for nonlinear trends through time, as found in eye tracking data. GAMMs can also include (linear or nonlinear) random effects, and account for autocorrelation in the time-dependent data (i.e., one data point in time is necessarily correlated to the preceding data point, which can yield to an overconfidence of model estimates; Baayen, van Rij, de Cat & Wood, 2018;Porretta, Kyröläinen, van Rij & Järvikivi, 2018). Furthermore, GAMMs do not assume normal distribution of the data, which makes them appropriate for eye fixation data.…”

Section: Analysis Proceduresmentioning

confidence: 99%

Monolingual and bilingual children's processing of coarticulation cues during spoken word recognition

2020

View full text Add to dashboard Cite

Bilingual children cope with a significant amount of phonetic variability when processing speech, and must learn to weigh phonetic cues differently depending on the cues’ respective roles in their two languages. For example, vowel nasalization is coarticulatory and contrastive in French, but coarticulatory-only in English. In this study, we extended an investigation of the processing of coarticulation in two- to three-year-old English monolingual children (Zamuner, Moore & Desmeules-Trudel, 2016) to a group of four- to six-year-old English monolingual children and age-matched English–French bilingual children. Using eye tracking, we found that older monolingual children and age-matched bilingual children showed more sensitivity to coarticulation cues than the younger children. Moreover, when comparing the older monolinguals and bilinguals, we found no statistical differences between the two groups. These results offer support for the specification of coarticulation in word representations, and indicate that, in some cases, bilingual children possess language processing skills similar to monolinguals.

show abstract

“…Despite its advantages for fitting time-series data, GAMM has not been used to analyze eyetracking data until recently (Porretta et al, 2018b). To our knowledge, to date, there have been no direct comparisons of GCA and GAMM analysis of Visual World data.…”

Section: Generalized Additive Mixed Model (Gamm) Analysis On Target Fmentioning

confidence: 99%

“…An exploratory analysis with generalized additive mixed modeling (GAMM) on target Benefits of the GAMM approach include: (1) the ability to account for autocorrelation often present in time-series data, (2) the ability to fit complex nonlinear curves more easily and flexibly with smooth terms, where a smooth term consists of a smoothing spline (i.e., piecewise polynomial function) and a penalization method for "wiggliness" to optimize function fit, and (3) the ability to model multidimensional continuous interactions in a straightforward way (Baayen, van Rij, de Cat, & Wood, 2016;Baayen, Vasishth, Kliegl, & Bates, 2017;Porretta, Kyröläinen, van Rij, & Järvikivi, 2018b;van Rij, 2015;Wieling, 2018;Winter & Wieling, 2016). Despite its advantages for fitting time-series data, GAMM has not been used to analyze eyetracking data until recently (Porretta et al, 2018b).…”

Section: Generalized Additive Mixed Model (Gamm) Analysis On Target Fmentioning

confidence: 99%

“…In order to use the Gaussian distribution to control for autocorrelation in the time series, proportion data generated in the VWP procedure were submitted to the empirical logit (an approximation to log odds) transformation with weights for variance estimation (Porretta et al, 2018a(Porretta et al, , 2018b. Further, the critical word onset of each trial was marked as the beginning of each time series to prepare for autocorrelation using itsadug::start_event() (van Rij, 2015;van Rij et al, 2017).…”

Section: Gamm Analysis Preprocessingmentioning

confidence: 99%

See 1 more Smart Citation

Individual Differences in Subphonemic Sensitivity and Phonological Skills

Li¹,

Braze²,

Kukona³

et al. 2017

Preprint

View full text Add to dashboard Cite

Many studies have established a link between phonological abilities (indexed by phonological awareness and phonological memory tasks) and typical and atypical reading development. Individuals who perform poorly on phonological assessments have been mostly assumed to have underspecified (or “fuzzy”) phonological re- presentations, with typical phonemic categories, but with greater category overlap due to imprecise encoding. An alternative posits that poor readers have overspecified phonological representations, with speech sounds perceived allophonically (phonetically distinct variants of a single phonemic category). On both accounts, mismatch between phonological categories and orthography leads to reading difficulty. Here, we consider the implications of these accounts for online speech processing. We used eye tracking and an individual differences approach to assess sensitivity to subphonemic detail in a community sample of young adults with a wide range of reading-related skills. Subphonemic sensitivity inversely correlated with meta-phonological task performance, consistent with overspecification.

show abstract

Visual World Paradigm Data: From Preprocessing to Nonlinear Time-Course Analysis

Cited by 42 publications

References 17 publications

Gradient and categorical patterns of spoken-word recognition and processing of phonetic details

Gradient and categorical patterns of spoken-word recognition and processing of phonetic details

Monolingual and bilingual children's processing of coarticulation cues during spoken word recognition

Individual Differences in Subphonemic Sensitivity and Phonological Skills

Contact Info

Product

Resources

About