The paper deals with a second order finite elasto-plastic model, which involves the defect density tensor, as a measure of the extra material defects existing in the damaged microstructure. The material behaviour is described with respect to an anholonomic configuration, which is introduced through the second order plastic deformation, consisting in plastic distortion and plastic connection. The defect density tensor enters the expression of the plastic connection through its gradient and represents a measure of non-metricity. The constitutive and evolution equations are derived to be compatible with the free energy imbalance. The evolution equation for the defect density tensor is non-local and coupled with the plastic distortion.