52% Yes, a signiicant crisis 3% No, there is no crisis 7% Don't know 38% Yes, a slight crisis 38% Yes, a slight crisis 1,576 RESEARCHERS SURVEYED M ore than 70% of researchers have tried and failed to reproduce another scientist's experiments, and more than half have failed to reproduce their own experiments. Those are some of the telling figures that emerged from Nature's survey of 1,576 researchers who took a brief online questionnaire on reproducibility in research. The data reveal sometimes-contradictory attitudes towards reproduc-ibility. Although 52% of those surveyed agree that there is a significant 'crisis' of reproducibility, less than 31% think that failure to reproduce published results means that the result is probably wrong, and most say that they still trust the published literature. Data on how much of the scientific literature is reproducible are rare and generally bleak. The best-known analyses, from psychology 1 and cancer biology 2 , found rates of around 40% and 10%, respectively. Our survey respondents were more optimistic: 73% said that they think that at least half of the papers in their field can be trusted, with physicists and chemists generally showing the most confidence. The results capture a confusing snapshot of attitudes around these issues, says Arturo Casadevall, a microbiologist at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland. "At the current time there is no consensus on what reproducibility is or should be. " But just recognizing that is a step forward, he says. "The next step may be identifying what is the problem and to get a consensus. "

Three methods for fitting the diffusion model (Ratcliff, 1978) to experimental data are examined. Sets of simulated data were generated with known parameter values, and from fits of the model, we found that the maximum likelihood method was better than the chi-square and weighted least squares methods by criteria of bias in the parameters relative to the parameter values used to generate the data and standard deviations in the parameter estimates. The standard deviations in the parameter values can be used as measures of the variability in parameter estimates from fits to experimental data. We introduced contaminant reaction times and variability into the other components of processing besides the decision process and found that the maximum likelihood and chi-square methods failed, sometimes dramatically. But the weighted least squares method was robust to these two factors. We then present results from modifications of the maximum likelihood and chi-square methods, in which these factors are explicitly modeled, and show that the parameter values of the diffusion model are recovered well. We argue that explicit modeling is an important method for addressing contaminants and variability in nondecision processes and that it can be applied in any theoretical approach to modeling reaction time.Sequential sampling models are currently the models most successful in accounting for data from simple two-choice tasks. Among these, diffusion models have been the ones most widely applied across a range of experimental procedures, including memory (Ratcliff, 1978(Ratcliff, , 1988, lexical decision (Ratcliff, Gomez, & McKoon, 2002), letter-matching (Ratcliff, 1981, visual search (Strayer & Kramer, 1994), decision making (Busemeyer & Townsend, 1993;Diederich, 1997;Roe, Busemeyer, & Townsend, 2001), simple reaction time (Smith, 1995), signal detection (Ratcliff & Rouder, 1998;Ratcliff, Thapar, & McKoon, 2001;Ratcliff, Van Zandt, & McKoon, 1999), and perceptual judgments (Ratcliff, 2002;Ratcliff & Rouder, 2000; Thapar, Ratcliff, & McKoon, 2002).The experimental data to which the models are fit in two-choice tasks are accuracy rates and reaction time distributions for both correct and error responses. The ability of the models to deal with this range of data sets them apart from other models for two-choice decisions. Because multiple dependent variables need to be fit simultaneously and because the data can have contaminants, the fitting process is not straightforward. For these reasons, the model is a good testing ground for evaluating fitting methods.In fitting any sequential sampling model to data, the aim is to find parameter values for the model that allow it to produce predicted values for reaction times and accuracy rates that are Correspondence concerning this article should be addressed to R. Ratcliff, Department of Psychology, Northwestern University, Evanston, IL 60208 (e-mail: r-ratcliff@nwu.edu). NIH Public Access Author ManuscriptPsychon Bull Rev. Author manuscript; available in PMC 2008 July 17. Published...

Psychology has been stirred by dramatic revelations of questionable research practices (John, Loewenstein, & Prelec, 2012), implausible findings (Wagenmakers, Wetzels, Borsboom, & van der Maas, 2011), and low reproducibility (Open Science Collaboration, 2015; Yong, 2012). The resulting crisis of confidence has led to a wide array of recommendations for improving research practices. Commonly cited advice includes replication, high power, copiloting, adjusting the alpha level, focusing on estimation rather than on testing, and adopting Bayesian statistics (e.g.,

In the network approach to psychopathology, disorders are conceptualized as networks of mutually interacting symptoms (e.g., depressed mood) and transdiagnostic factors (e.g., rumination). This suggests that it is necessary to study how symptoms dynamically interact over time in a network architecture. In the present paper, we show how such an architecture can be constructed on the basis of time-series data obtained through Experience Sampling Methodology (ESM). The proposed methodology determines the parameters for the interaction between nodes in the network by estimating a multilevel vector autoregression (VAR) model on the data. The methodology allows combining between-subject and within-subject information in a multilevel framework. The resulting network architecture can subsequently be analyzed through network analysis techniques. In the present study, we apply the method to a set of items that assess mood-related factors. We show that the analysis generates a plausible and replicable network architecture, the structure of which is related to variables such as neuroticism; that is, for subjects who score high on neuroticism, worrying plays a more central role in the network. Implications and extensions of the methodology are discussed.

About 17% of humanity goes through an episode of major depression at some point in their lifetime. Despite the enormous societal costs of this incapacitating disorder, it is largely unknown how the likelihood of falling into a depressive episode can be assessed. Here, we show for a large group of healthy individuals and patients that the probability of an upcoming shift between a depressed and a normal state is related to elevated temporal autocorrelation, variance, and correlation between emotions in fluctuations of autorecorded emotions. These are indicators of the general phenomenon of critical slowing down, which is expected to occur when a system approaches a tipping point. Our results support the hypothesis that mood may have alternative stable states separated by tipping points, and suggest an approach for assessing the likelihood of transitions into and out of depression. D epression is one of the main mental health hazards of our time. It can be viewed as a continuum with an absence of depressive symptoms at the low endpoint and severe and debilitating complaints at the high end (1). (Throughout this manuscript, the term "depression" refers to this continuum of depressive symptoms.) The diagnosis major depressive disorder (MDD) defines individuals at the high end of this continuum. Approximately 10-20% (2) of the general population will experience at least one episode of MDD during their lives, but even subclinical levels of depression may considerably reduce quality of life and work productivity (3). Depressive symptoms are therefore associated with substantial personal and societal costs (4,5). The onset of MDD in an individual can be quite abrupt, and similarly rapid shifts from depression into a remitted state, so-called sudden gains, are common (6). However, despite the high prevalence and associated societal costs of depression, we have little insight into how such critical transitions from health to depression (and vice versa) in individuals might be foreseen. Traditionally, the broad array of correlated symptoms found in depressed people (e.g., depressed mood, insomnia, fatigue, concentration problems, loss of interest, suicidal ideation, etc.) was thought to stem from some common cause, much as a lung tumor is the common cause of symptoms such as shortness of breath, chest pain, and coughing up blood. Recently, however, this common-cause view has been challenged (7-9). The alternative view is that the correlated symptoms should be regarded as the result of interactions of components of a complex dynamical system (7,(10)(11)(12). Consequently, new models of the etiology of depression involve a network of interactions between components, such as emotions, cognitions, and behaviors (8,9). This implies, for instance, that a person may become depressed through a causal chain of feelings and experiences, such as the following: stress → negative emotions → sleep problems → anhedonia (9, 13-15). However, the network view also implies that there can be positive feedback mechanisms between symptoms, such...