This paper discusses the evolution of adaptive filtering, filter structure, adaptive algorithms used for noise cancellation over the past five decades. The field of adaptive signal processing has been matter of research for over 50-60 years. The major growth occurred in this field in eighties because of the availability of implementation tools and textbooks. Adaptive signal processing has made a significant contribution in the last 50 years. The applications of adaptive signal processing are very appealing because of its properties like low costing, constancy, fidelity, small sizes, and adjustability. This revolutionary change brought along with the problems of noise and the solution is the design of the adaptive filter. This paper mainly focused on adaptive filter, and its structure, the Least Mean Square Algorithm (LMS) and Normalized Least Mean Square Algorithm (NLMS), used for noise cancellation. This paper could serve as a survey for beginners and as a reference to select the related reference of their field.