Consider the free algebra An generated over Q by n generators x1, . . . , xn. Interesting objects attached to A = An are members of its lower central series, Li = Li(A), defined inductively by L1 = A, Li+1 = [A, Li], and their associated graded components Bi = Bi(A) defined as Bi = Li/Li+1. These quotients Bi for i ≥ 2, as well as the reduced quotientB1 = A/(L2 + AL3), exhibit a rich geometric structure, as shown by Feigin and Shoikhet [FS] and later authors,We study the same problem over the integers Z and finite fields Fp. New phenomena arise, namely, torsion in Bi over Z, and jumps in dimension over Fp. We describe the torsion in the reduced quotientB1 and B2 geometrically in terms of the De Rham cohomology of Z n . As a corollary we obtain a complete description ofB1(An(Z)) andB1(An(Fp)), as well as of B2(An(Z[1/2])) and B2(An(Fp)), p > 2. We also give theoretical and experimental results for Bi with i > 2, formulating a number of conjectures and questions on their basis. Finally, we discuss the supercase, when some of the generators are odd and some are even, and provide some theoretical results and experimental data in this case.