The authors show that in the gravity with a non‐metricity scalar , the curvatures in Einstein's gravity, that is, the Riemann curvature constructed from the standard Levi‐Civita connection, could not be excluded or naturally appear. The first observation is that even in gravity, the conservation of the matter energy‐momentum tensor is not described by the covariant derivatives in the non‐metricity gravity but that is given by the Levi‐Civita connection. The commutator of the covariant derivatives in Einstein's gravity inevitably induces the Riemann curvature. There is no symmetry nor principle which prohibits the Riemann curvature in non‐metricity gravity. Based on this observation, the authors propose and investigate gravity with the Gauss–Bonnet invariant and its generalizations. The authors also show how models realizing any given the Friedmann–Lemaître–Robertson– Walker (FLRW) spacetime can be reconstructed. The reconstruction formalism to cosmology is applied. Explicitly, the gravity models which realize slow roll or constant roll inflation, dark energy epoch as well as the unification of the inflation and dark energy are found. The dynamical autonomous system and the gravitational wave in the theory under investigation are discussed. It is found the condition that the de Sitter spacetime becomes the (stable) fixed point of the system.