We study nonuniform states and possible glassiness triggered by a competition between distinct local orders in disorder-free systems. Both in Ginzburg-Landau theories and in simple field theories, such inhomogeneous states arise from negative gradient terms between the competing order parameters. We discuss applications of these ideas to a variety of strongly correlated systems.