In this paper, we propose an iterative detection algorithm that reconstructs and cancels the multiple-access interference jointly without the knowledge of hopping patterns of the interfering users for SFH/BPSK systems in an ad hoc scenario. Since users are asynchronous in this scenario, signal in one hop of the desired users is affected by partial signals in unaligned hops, called the interference fragments, of the interfering users. We address the interference model by defining a virtual user, which has the same hopping pattern as that of the desired user and contains the feature of the interfering fragments. Then, we derive the joint interference reconstruction and multiple-user detection (MUD) algorithm using the factor graph framework. Simulation results show that the performance of the proposed algorithm can be improved by up to 2 dB than that of the traditional single user detection (SUD) in AWGN at the packet error rate of 10 −2 for a total of 8 users over 20 hopping frequencies, and an outstanding performance may also be achieved in the channel with Doppler.