A 2–4 decoder based on all-spin logic (ASL) and magnetic tunnel junction (MTJ) is proposed. The proposed 2–4 decoder employs 5-input minority gates and single-input single-fan-out (SISF) structure. Meanwhile, the inverters are eliminated by initializing the magnetization of the MTJ fixed layer in different directions to realize the inputs of the original or inverse variables. To ensure that the proposed 2–4 decoder works properly, an asynchronous clock scheme is proposed, which divides the input signal into three phases and the operating voltage into two phases in one clock cycle. The operation of the proposed decoder is validated by the magnetization dynamics/spin transport self-consistent simulation framework, and the simulation results show that the delay and energy dissipation of the decoder are at the level of nanosecond and femtojoule, respectively. In addition, to illustrate the advantages of the 5-input minority gate, inverter-free structure, and SISF structures in the design of the proposed 2–4 decoder, a second 2–4 decoder is proposed using 3-input minority gates, inverters, and single-input multiple-fan-out structure. Compared with the second decoder, the layout area of the first decoder is reduced to 37.9%, the total channel length is reduced to 40.8%, the number of clock cycles is reduced to 1/3, and the energy dissipation is reduced by at least 3 orders of magnitude. Importantly, the design methods used in this work, such as multi-input minority gates, SISF structure, and inverter-free structure, provide an interesting approach for designing large-scale ASL logic circuits.