The automorphism group Aut(Fn) of the free group Fn acts on a space A d (n) of Jacobi diagrams of degree d on n oriented arcs. We study the Aut(Fn)-module structure of A d (n) by using two actions on the associated graded vector space of A d (n): an action of the general linear group GL(n, Z) and an action of the graded Lie algebra gr(IA(n)) of the IA-automorphism group IA(n) of Fn associated with its lower central series. We extend the action of gr(IA(n)) to an action of the associated graded Lie algebra of the Andreadakis filtration of the endomorphism monoid of Fn. By using this action, we study the Aut(Fn)-module structure of A d (n). We obtain a direct decomposition of A d (n) as Aut(Fn)-modules for general d, which is indecomposable for d = 3, 4. Moreover, we obtain the radical of A d (n) for general d and the socle of A 3 (n). Contents 1. Introduction 1 2. Preliminaries 6 3. Andreadakis filtration E * (n) of End(F n ) 11 4. Action of gr(E * (n)) on B d (n) 17 5. Contraction map 26 6. Correspondence between the map βr d,k and the map γ r d,k 30 7. The GL(V n )-module structure of B d (n) 33 8. The Aut(F n )-module structure of A d (n) 40 9. The functor A d 50 Appendix A. Presentation of the category A L 51 References 54