This paper presents a concept of the non-stationary filtering network with reduced transient response consisting of the first-order digital elements with time-varying parameters. The digital filter section is based on the analog system. In order to design the filtering network, the analog prototype was subjected to the discretization process. The time constant and the gain factor were then temporarily varied in time in order to suppress the transient response of the designed filtering structure. The optimization method, based on the Particle Swarm Optimization (PSO) algorithm which is aimed at reducing the settling time by a proper parameter manipulation, is presented. Simulation results proving the usefulness of the proposed concept are also shown and discussed.