Intimate partner violence (IPV) is a pervasive public health problem. Within the U.S., urban emergency department (ED) patients have elevated prevalence of IPV, substance use, and other social problems compared to those in the general household population. Using a social-ecological framework, this cross-sectional study analyzes the extent to which individual, household, and neighborhood factors are associated with the frequency of IPV among a socially disadvantaged sample of urban ED patients. Confidential survey interviews were conducted with 1037 married/partnered study participants (46% male; 50% Hispanic; 29% African American) at a public safety-net hospital. Gender-stratified multilevel Tobit regression models were estimated for frequency of past-year physical IPV (perpetration and victimization) and frequency of severe IPV. Approximately 23% of participants reported IPV. Among men and women, impulsivity, adverse childhood experiences, substance use, and their spouse/partner’s hazardous drinking were associated with IPV frequency. Additionally, household food insufficiency, being fired or laid off from their job, perceived neighborhood disorder, and neighborhood demographic characteristics were associated with IPV frequency among women. Similar patterns were observed in models of severe IPV frequency. IPV prevention strategies implemented in urban ED settings should address the individual, household, and neighborhood risk factors that are linked with partner aggression among socially disadvantaged couples.