We find a series of non-Abelian topological phases that are separated from the deconfined phase of ZN gauge theory by a continuous quantum phase transition. These non-Abelian states, which we refer to as the "twisted" ZN states, are described by a recently studied U (1) × U (1) ⋊ Z2 ChernSimons (CS) field theory. The U (1) × U (1) ⋊ Z2 CS theory provides a way of gauging the global Z2 electric-magnetic symmetry of the Abelian ZN phases, yielding the twisted ZN states. We introduce a parton construction to describe the Abelian ZN phases in terms of integer quantum Hall states, which then allows us to obtain the non-Abelian states from a theory of Z2 fractionalization. The non-Abelian twisted ZN states do not have topologically protected gapless edge modes and, for N > 2, break time-reversal symmetry.