Efficient and rapid deployment of maritime search and rescue(MSAR) resources is a prerequisite for maritime emergency search and rescue, in order to improve the efficiency and accuracy of MSAR. This paper proposes an integrated approach for emergency resource allocation. The approach encompasses three main steps: identifying accident black spots, assessing high-risk areas, and optimizing the outcomes through a synergistic combination of an optimization algorithm and reinforcement learning. In the initial step, the paper introduces the iterative self-organizing data analysis technology (ISODATA) for identifying accident spots at sea. A comparative analysis is conducted with other clustering algorithms, highlighting the superiority of ISODATA in effectively conducting dense clustering. This can effectively carry out dense clustering, instead of the situation where the data spots are too dispersed or obvious anomalies that affect the clustering. Furthermore, this approach incorporates entropy weighting to reassess the significance of accident spots by considering both the distance and the frequency of accidents. This integrated approach enhances the allocation of search and rescue forces, ensuring more efficient resource utilization. To address the MSAR vessel scheduling problem at sea, the paper employs the non-dominated sorting genetic algorithm II combined with reinforcement learning (NSGAII-RL). Comparative evaluations against other optimization algorithms reveal that the proposed approach can save a minimum of 7% in search and rescue time, leading to enhanced stability and improved efficiency in large-scale MSAR operations. Overall, the integrated approach presented in this paper offers a robust solution to the ship scheduling problem in maritime search and rescue operations. Its effectiveness is demonstrated through improved resource allocation, enhanced timeliness, and higher efficiency in responding to maritime accidents.