We calculate the electronic spectrum of bilayer graphene in perpendicular magnetic fields nonperturbatively. To accomodate arbitrary displacements between the two layers, we apply a periodic gauge based on singular flux vortices of phase 2π. The resulting Hofstadter-like butterfly plots show a reduced symmetry, depending on the relative position of the two layers against each other. The split of the zero-energy relativistic Landau level differs by one order of magnitude between Bernal and non-Bernal stacking. After the theoretical prediction of the peculiar electronic properties of graphene in 1947 by Wallace 1 and the subsequent studies of its magnetic spectrum, 2,3 it took half a century until single layers of graphene could be isolated in experiment 4 and the novel mesoscopic properties of these two-dimensional (2D) Dirac-like electronic systems, e.g., their anomalous quantum Hall effect, could be measured. 5,6,7 Inspired by this experimental success, graphene has become the focus of numerous theoretical works. 8,9,10,11,12 For bilayers of graphene, an additional degeneracy of the Landau levels and a Berry phase of 2π were predicted to lead to an anomalous quantum Hall effect, different from either the regular massive electrons or the special Dirac-type electrons of single-layer graphene, 13 which was confirmed in experiment shortly afterwards 14 and used for the characterization of bilayer samples. 15The low-energy electronic structure of a single layer of graphene is well described by a linearization near the corner points of the hexagonal Brillouin zone (K points), resulting in an effective Hamiltonian formally equivalent to that of massless Dirac particles in two dimensions. 16