Developing low‐cost and exceedingly efficient electrocatalysts for oxygen evolution reaction (OER) is vital for application of hydrogen production from water splitting. Herein, three different nickel sulfides on nickel foam were fabricated via a simple sulfuring the as‐formed Ni‐MOF with different sulfide as the sulfur source. The effect of sulfur source on OER performance, morphology and structure of the as‐prepared product are well discussed. The optimized Ni‐MOF/NF‐SS deliver overpotentials of 253 and 330 mV to reach current densities of 10 and 100 mA cm−2 with a small Tafel slope of 70.9 mVdec−1, and stability of over 50 h. This work provides insights into the relationship between the OER activity and the structures of nickel sulfides, but also affords a new route to fabricate nickel sulfides‐based electrocatalysts for OER.