In recent years, several fast solvers for the solution of the Lippmann-Schwinger integral equation that mathematically models the scattering of time-harmonic acoustic waves by penetrable inhomogeneous obstacles, have been proposed. While many of these fast methodologies exhibit rapid convergence for smoothly varying scattering configurations, the rate for most of them reduce to either linear or quadratic when material properties are allowed to jump across the interface. A notable exception to this is a recently introduced Nyström scheme [J. Comput. Phys., 311 (2016), 258-274] that utilizes a specialized quadrature in the boundary region for a high-order treatment of the material interface. In this text, we present a solution framework that relies on the specialized boundary integrator to enhance the convergence rate of other fast, low order methodologies without adding to their computational complexity of O(N log N) for an N-point discretization. In particular, to demonstrate the efficacy of the proposed framework, we explain its implementation to enhance the order to convergence of two schemes, one introduced by Duan and Rokhlin [J. Comput. Phys., 228(6) (2009), 2152-2174] that is based on a pre-corrected trapezoidal rule while the other by Bruno and Hyde [J. Comput. Phys., 200(2) (2004), 670-694] which relies on a suitable decomposition of the Green's function via Addition theorem. In addition to a detailed description of these methodologies, we also present a comparative performance study of the improved versions of these two and the Nyström solver in [J. Comput. Phys., 311 (2016), 258-274] through a wide range of numerical experiments.designed for a high-order treatment of discontinuous material interfaces [22] does converge rapidly with optimal computational cost, the griding strategy used therein, in certain cases, can restrict the methodology from achieving the theoretical computational complexity. Indeed, as we show later in this text, the scheme in [22] produces far less accurate approximations to the solution when compared to their counterparts obtained through the proposed approach.Apart from these, a couple of fast direct solvers with computational cost O(N 3/2 ) have also been proposed in [20,21] that primarily rely on quad-tree data structure. While these methods offer several advantages, such as, robustness and capability to handle some large scale frequency regime, they are designed only for material properties that are globally smooth.The primary aim of this paper is to provide a framework that allows us to enhance the rate of convergence for those existing O(N log N) solvers that converge rapidly for smooth inhomogeneities but yield low order in the context of discontinuous scattering media, without adversely effecting their asymptotic computational complexity. Indeed, most fast solvers converge slowly in the presence of material discontinuities because evaluation of the integral operator (5) through fast algorithms (e.g., FFT, AIM, FMM, etc.) require them to integrate across the material inte...