Although memory-dependent derivative (MDD) has recently been the subject of extensive study, only one numerical approximation has been reported in the literature. Hence, this study introduces a novel approximation for MDD. Moreover, a new form of the kernel function is presented. The convergence order of our approximation is O(h^(3-S) ),0<S<1, where (1-S) is the exponent of the kernel function. The proposed approach is used to numerically solve the memory-dependent advection-diffusion problem, and the numerical scheme’s stability and convergence are discussed. Also, memory-based models have been described to study drug delivery and its diffusion from multi-layer capsules/tablets. These models are based on the fractional derivative and the MDD to solve the paradox of the unphysical feature of the infinite propagation speed of the published Fickian-based models. The theoretical analysis is validated with numerical examples by investigating the convergence order that is (3-S) in time. To illustrate the validity and efficiency of the proposed models, profiles of concentration and drug mass are compared with the observed in vivo data. It is observed to be highly accurate and compatible with the in vivo data when compared with Fick’s model.