In this paper the distributed leader-follower consensus tracking problem is investigated for unknown nonlinear non-affine discrete-time multi-agent systems. Via a dynamic linearization method both for the agent system and the local ideal distributed controller, a distributed adaptive control scheme is proposed in this paper using the Newton-type optimization method. The proposed approach is data-driven since only the local measurement information among neighboring agents is utilized in the control system design. The consensus tracking stabilities of the proposed approach are rigorously guaranteed in the cases of fixed and switching communication topologies. The simulations are conducted to verify the effectiveness of the proposed approach. INDEX TERMS Dynamic linearization, data-driven control, adaptive control, multi-agent systems, consensus tracking.