Let us fix a prime p and a homogeneous system of m linear equations aj,1x1 + • • • + a j,k x k = 0 for j = 1, . . . , m with coefficients aj,i ∈ Fp. Suppose that k ≥ 3m, that aj,1 + • • • + a j,k = 0 for j = 1, . . . , m and that every m × m minor of the m × k matrix (aj,i)j,i is non-singular. Then we prove that for any (large) n, any subset A ⊆ F n p of size |A| > C • Γ n contains a solution (x1, . . . , x k ) ∈ A k to the given system of equations such that the vectors x1, . . . , x k ∈ A are all distinct. Here, C and Γ are constants only depending on p, m and k such that Γ < p.The crucial point here is the condition for the vectors x1, . . . , x k in the solution (x1, . . . , x k ) ∈ A k to be distinct. If we relax this condition and only demand that x1, . . . , x k are not all equal, then the statement would follow easily from Tao's slice rank polynomial method. However, handling the distinctness condition is much harder, and requires a new approach. While all previous combinatorial applications of the slice rank polynomial method have relied on the slice rank of diagonal tensors, we use a slice rank argument for a non-diagonal tensor in combination with combinatorial and probabilistic arguments.