We show that it is possible to prepare and identify ultra-thin sheets of graphene on crystalline substrates such as SrTiO(3), TiO(2), Al(2)O(3) and CaF(2) by standard techniques (mechanical exfoliation, optical and atomic force microscopy). On the substrates under consideration we find a similar distribution of single layer, bilayer and few-layer graphene and graphite flakes as with conventional SiO(2) substrates. The optical contrast C of a single graphene layer on any of those substrates is determined by calculating the optical properties of a two-dimensional metallic sheet on the surface of a dielectric, which yields values between C = -1.5% (G/TiO(2)) and C = -8.8% (G/CaF(2)). This contrast is in reasonable agreement with experimental data and is sufficient to make identification by an optical microscope possible. The graphene layers cover the crystalline substrate in a carpet-like mode and the height of single layer graphene on any of the crystalline substrates as determined by atomic force microscopy is d(SLG) = 0.34 nm and thus much smaller than on SiO(2).