Background and Aims: There is a growing need for valid, efficient, and easy scoring scales to rate the quality of cohort studies. We aimed to develop and validate a quality assessment score to be used for cohort studies. Methods: We followed a rigorous process to establish content, face, and construct validity. Most questions were scored at 0 or 1. Inter-rater reliability and test-retest reliability were assessed using the Spearman correlation coefficient (r s) and Cohen's k statistic. Internal consistency was measured using the Kuder-Richardson formula 20 (KR20). Results: The final tool consists of 9 questions with a maximum score of 10. The inter-rater reliability was high with the Spearman correlation coefficient (r s Z .66). Agreement for inclusion was 90%. Test-retest reliability was high. For rater 1, r s Z .91, k Z .38 for scores, and k Z 1 for inclusion. For rater 2, r Z .94, 80% agreement for scores, and 100% agreement for inclusion. Internal consistency was reasonable based on 2 studies: KR20 Z .21 and KR20 Z .65. The novel scale rated highest in efficiency, understandably, ease of use, and ease of interpretation when compared with 3 other scales. Conclusions: This novel scale has favorable performance characteristics, is efficient to conduct, and is easy to interpret and will be very helpful for physicians and researchers conducting systematic reviews and meta-analyses. (Gastrointest Endosc 2021;93:486-94.) In recent years, clinicians have come to recognize that medical practices need to be based on systematic review of all available evidence. 1 In 2011, the Institute of Medicine, now the National Academy of Medicine, defined guidelines as "recommendations intended to optimize patient care that are informed by a systematic review of evidence." (p. 25)2 This evidence-based approach has become a critical aspect of the practice of medicine. The process is transparent, based on rigorous methodology, and reproducible. Adopting evidence-based guidelines has changed the way physicians, medical societies, and guideline panels use the medical literature to make clinical decisions. 3 Performing systematic reviews and meta-analyses are key components of all medical guidelines at this point. 4 An integral part of conducting a systematic review is to rate the quality of individual articles. 5 For this purpose, many scoring systems have been developed and validated. 6,7 However, the use of such quality scores has been fraught with several shortcomings. First, a large gap remains in the area of scoring cohort studies. These include prospective or retrospective studies, which were not designed as randomized trials. Although many scoring systems exist for randomized trails, 8 only a few scores have been developed for cohort studies. 9-11 Second, previous scales can be complex to use, score, and interpret. Last, many scoring tools did little to address specific concerns relating to the process of meta-analysis. We believe the ideal quality assessment scale for cohort studies Abbreviations: BE, Barrett's esophagus; KR20,...