According to the gauge/gravity duality, we use an Einstein-Maxwell-dilaton(EMD) model to study the running coupling constant at finite chemical potential and magnetic field. First, we calculate the effect of temperature on the running coupling constant and find the results are in consistent with lattice qualitatively. Subsequently, we calculate the effect of chemical potential and magnetic field on running coupling. It is found that the chemical potential and magnetic field both suppress the running coupling constant, however, the effect of magnetic field is slightly larger than chemical potential for a fixed temperature. Compared with the deconfinement phase, the magnetic field has a large influence on the running coupling in the confinement phase. Content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. Article funded by SCOAP3 and published under licence by Chinese Physical Society and the Institute of High Energy Physics of the Chinese Academy of Science and the Institute of Modern Physics of the Chinese Academy of Sciences and IOP Publishing Ltd.