Video gaming is a popular source of entertainment among children and adolescents. Although the Middle East is home to one of the fastest growing communities of video game users, most of the research established on this topic has been carried out through small scale studies. Our aim in this study is to assess the prevalence of video game use and its association with aggressive behaviors among adolescents in Saudi Arabia. This is a cross-sectional study involving boys and girls (aged 15–18 years) in both private and public secondary high schools in Riyadh, Saudi Arabia. Each participant completed a self-administered modified version of the aggression questionnaire, which consisted of 29 items scored on a 5-point Likert scale. This questionnaire assessed aggressive behaviors domains: physical aggression, anger, hostility, and verbal aggression and types of videogames and time of use. A total of 485 students were included in this study. The mean age of participants was 16.5 ± 0.9 years; 48% were boys. Adolescents who participated in action games had higher mean verbal (p < 0.01) and physical aggression (p < 0.01) scores. Adventure game players had significantly higher mean scores in all four types of aggressive behavior (p < 0.01). Participants who played simulation games had higher mean verbal aggressiveness (p < 0.01). Adolescents who participated in sports games had greater mean levels of anger (p = 0.01) and physical aggression (p = 0.01). Those who played strategy/puzzle games reported significantly higher mean scores of anger (p < 0.01), hostility (p = 0.01), and verbal aggression (p = 0.01). Females were more likely to show higher mean anger (p < 0.01) scores, whereas males were more likely to show higher mean physical aggression scores (p < 0.01). Conclusions: Our results do suggest that playing video games increases adolescent aggressive behaviors, which has been supported by other studies. We recommend educating parents on the pros and cons of playing video games and that parents schedule and limit the time their children spend playing video games.