In this article, we focus on a class of singular linear systems of fractional differential equations with given non-consistent initial conditions (IC). Since the nonconsistency of the IC can not lead to a unique solution for the singular system, we use two optimization techniques to provide an optimal solution for the system. A 2 perturbation to the non-consistent IC which seeks an optimal solution for the system in terms of least squares, and a second order optimization technique at a 1 minimum perturbation to the non-consistent IC, including appropriate smoothing. Numerical examples are given to justify our theory. We use the Caputo (C) fractional derivative and two recently defined alternative versions of this derivative, the Caputo-Fabrizio (CF) and the Atangana-Baleanu (AB) fractional derivative.