Understanding symmetries and transitions in non-Hermitian matrices and their physical consequences is of tremendous interest in the context of open quantum systems. The spectrum of one dimensional tight-binding chain with periodic on-site potential can be obtained by casting the problem in terms of 2 × 2 transfer matrices. We find that these non-Hermitian matrices have a symmetry akin to parity-time symmetry, and hence show transitions across exceptional points. The exceptional points of the transfer matrix of a unit cell correspond to the band edges of the spectrum. When connected to two zero temperature baths at two ends, this consequently leads to subdiffusive scaling of conductance with system size, with an exponent 2, if the chemical potential of the baths are equal to the band edges. We further demonstrate the existence of a dissipative quantum phase transition as the chemical potential is tuned across any band edge. Remarkably, this feature is analogous to transition across a mobility edge in quasi-periodic systems. This behavior is universal, irrespective of the details of the periodic potential and the number of bands of the underlying lattice. It, however, has no analog in absence of the baths.