In November 2015, the Association of American Medical Colleges (AAMC) held its annual meeting in Baltimore, Maryland. In response both to health and health care inequities faced by residents of Baltimore and to the imminent trial of the police officers charged with Freddie Gray's death, AAMC leaders thought it crucial to address issues of health inequity, social injustice, and the role an academic health center (AHC) can play in improving the health of the community it serves. In collaboration with community-engaged researchers from Johns Hopkins University and University of Maryland, Baltimore, AAMC staff interviewed Baltimore residents, soliciting their perspectives on how medical education, clinical care, and research can and should respond to social injustice and the social determinants of health. The authors used the resulting videoed interviews to frame a conversation during the annual meeting aimed at developing concrete actions that an individual, an institution, or the AAMC can take to address social injustice and health inequities in the Baltimore community and beyond. The robust conversation and the action steps identified by participants led to the development of a toolkit to build the capacity of AHCs and their communities to engage in similar, action-oriented programming. The success of the conversation inspired future meeting sessions that purposefully incorporate community voices and expertise. This Perspective presents results of this action planning and places the proposed set of activities within the current health care context to demonstrate how community expertise and wisdom can inform and advance efforts to improve the health of all.