Phytochromes are photoreceptors in plants, fungi, and various microorganisms and cycle between metastable red light-absorbing (Pr) and far-red light-absorbing (Pfr) states. Their light responses are thought to follow a conserved structural mechanism that is triggered by isomerization of the chromophore. Downstream structural changes involve refolding of the so-called tongue extension of the phytochrome-specific GAF-related (PHY) domain of the photoreceptor. The tongue is connected to the chromophore by conserved DIP and PRSF motifs and a conserved tyrosine, but the role of these residues in signal transduction is not clear. Here, we examine the tongue interactions and their interplay with the chromophore by substituting the conserved tyrosine (Tyr) in the phytochrome from the extremophile bacterium with phenylalanine. Using optical and FTIR spectroscopy, X-ray solution scattering, and crystallography of chromophore-binding domain (CBD) and CBD-PHY fragments, we show that the absence of the Tyr hydroxyl destabilizes the β-sheet conformation of the tongue. This allowed the phytochrome to adopt an α-helical tongue conformation regardless of the chromophore state, hence distorting the activity state of the protein. Our crystal structures further revealed that water interactions are missing in the Y263F mutant, correlating with a decrease of the photoconversion yield and underpinning the functional role of Tyr in phytochrome conformational changes. We propose a model in which isomerization of the chromophore, refolding of the tongue, and globular conformational changes are represented as weakly coupled equilibria. The results also suggest that the phytochromes have several redundant signaling routes.