We attempt to replicate 67 papers published in 13 well-regarded economics journals using author-provided replication files that include both data and code. Some journals in our sample require data and code replication files, and other journals do not require such files. Aside from 6 papers that use confidential data, we obtain data and code replication files for 29 of 35 papers (83%) that are required to provide such files as a condition of publication, compared to 11 of 26 papers (42%) that are not required to provide data and code replication files. We successfully replicate the key qualitative result of 22 of 67 papers (33%) without contacting the authors. Excluding the 6 papers that use confidential data and the 2 papers that use software we do not possess, we replicate 29 of 59 papers (49%) with assistance from the authors. Because we are able to replicate less than half of the papers in our sample even with help from the authors, we assert that economics research is usually not replicable. We conclude with recommendations on improving replication of economics research.

No abstract

One hundred young patients with recurrent otitis media with effusion (OME) were evaluated for IgE-mediated hypersensitivity by critical analysis of history, physical findings, skin testing for selected antigen, laboratory determination of total IgE, and radioallergosorbent testing (RAST) for six inhalant and two food allergens. The patients could be divided into allergic rhinitis and nonallergic groups. Allergic rhinitis patients had higher total IgE in their serum, and middle ear effusion (MEE). IgE was elevated in 16 of 35 allergic patients. In 8 of these 16 (23% of the allergic group), the IgE/mg protein was higher in the MEE than in the corresponding serum, suggesting local production of IgE. Nasal IgE was substantially increased in the allergic patients; however, in many patients there was no correlation between the corresponding MEE IgE and elevated nasal IgE, suggesting that local production of nasal and middle ear IgE is independent. We conclude that IgE-mediated allergic reactions may play a role in the pathogenesis of OME in about 23% of young allergic patients.

We attempted to replicate 67 macroeconomic papers using author-provided data and code files by following a preanalysis plan. Excluding 6 papers that used confidential data, we obtained data and code replication files for 29 of 35 papers (83 percent) that were required to provide such files as a condition of publication, compared to 11 of 26 papers (42 percent) that were not required to provide such files. Also excluding the 2 papers that used software we did not possess, we replicated 29 of 59 papers (49 percent) with assistance from the authors. We conclude with recommendations on improving replication of economics research.

No abstract