Objectives: To determine the test-retest reliability, concurrent, convergent, and discriminant validity of a recently devised screen ("Newton screen") for alcohol and cannabis use/misuse, and its predictive validity at follow up. Study design: Adolescents, 12-17 years old (N=4,898), treated in one of 16 participating pediatric emergency departments (PEDs) across the United States were enrolled in a study as part of a larger study within the Pediatric Emergency Care Applied Research Network (PECARN). Concurrent and predictive validity (at 1, 2, and 3-year follow-up) were assessed in a random subsample with a structured Diagnostic and Statistical Manual of Mental Disorders (DSM)-based interview. Convergent validity was assessed with the Alcohol Use Disorders Identification (AUDIT), a widely used alcohol screening measure. Results: The sensitivity of the Newton screen for alcohol use disorder (AUD) at baseline was 78.3% with a specificity of 93.0%. The cannabis use question had a baseline sensitivity of 93.1% and specificity of 93.5% for cannabis use disorder (CUD). Predictive validity analyses at 1, 2, and 3 years revealed high specificity but low sensitivity for alcohol and high specificity and moderate sensitivity for cannabis. Conclusion: The Newton screening instrument may be an appropriate brief screening tool for use in the busy clinical environment. Specificity was high for both alcohol and cannabis, but sensitivity was higher for cannabis than alcohol. Like other brief screens, more detailed follow-up