We reinvestigate how generic off-diagonal cosmological solutions depending, in general, on all spacetime coordinates can be constructed in massive and fmodified gravity using the anholonomic frame deformation method. New classes of locally anisotropic and (in-) homogeneous cosmological metrics are constructed with open and closed spatial geometries. By resorting to such solutions, we show that they describe the late time acceleration due to effective cosmological terms induced by nonlinear off-diagonal interactions, possible modifications of the gravitational action and graviton mass. The cosmological metrics and related Stückelberg fields are constructed in explicit form up to nonholonomic frame transforms of the Friedmann-Lamaître-Robertson-Walker (FLRW) coordinates. The solutions include matter, graviton mass, and other effective sources modeling nonlinear gravitational and matter field interactions with polarization of physical constants and deformations of metrics, which may explain dark energy and dark matter effects. However, we argue that it is not always necessary to modify gravity if we consider the effective generalized Einstein equations with nontrivial vacuum and/or non-minimal coupling with matter. Indeed, we state certain conditions when such configurations mimic interesting solutions in general relativity and modifications, for instance, when we can extract the general Painlevé-Gullstrand and FLRW metrics. In a more general context, we elaborate on a reconstruction procedure for off-diagonal cosmological solutions which describe cyclic and ekpyrotic universes. Finally, open issues and further perspectives are discussed.Associated visiting research affiliation