In this paper, we prove, for primes l satisfying some conditions, the l-parts of the Galois Brumer-Stark conjecture, which is formulated by Dejou and Roblot for Galois CM-extensions with dihedral or generalized quaternion Galois group of specified degrees.