In this paper it is shown that Fano double quadrics of index 1 and dimension at least 6 are birationally superrigid if the branch divisor has at most quadratic singularities of rank at least 6. Fano double cubics of index 1 and dimension at least 8 are birationally superrigid if the branch divisor has at most quadratic singularities of rank at least 8 and another minor condition of general position is satisfied. Hence, in the parameter spaces of these varieties the complement to the set of factorial and birationally superrigid varieties is of codimension at least