This article is devoted to a new method for removing texture in images through an image region classification technique using a smoothing rotating filter followed by a diffusion process designed to preserve object contours. This approach lies in associating a descriptor, capable of classifying each pixel as a texture pixel, a homogenous region pixel or an edge pixel, with an anisotropic edge detector serving to define two directions of the edges introduced into an anisotropic diffusion algorithm. Due to the presence of the image region descriptor, the anisotropic diffusion is able to accurately control diffusion near the edges and corner points and moreover remove textured regions. Our results and evaluations based on image segmentation and classical edge detection, which correctly extract objects within the image, compared with anisotropic diffusion methods and nonlinear filters, enable validating our approach.