Gap junction (GJ) channels mediate direct intercellular communication and are composed of two docked hemichannels (connexin oligomers). It is well documented that the docking and formation of GJs are possible only between compatible hemichannels (or connexins). The mechanisms of heterotypic docking compatibility are not fully clear. We aligned the protein sequences of docking-compatible and -incompatible connexins with that of connexin26 (Cx26). We found that two docking hydrogen bond (HB)-forming residues on the second extracellular domain (E2) of Cx26 and their equivalent residues are well conserved within docking-compatible connexins, but different between docking-incompatible connexins. Replacing one or both of these residues of Cx26 into the corresponding residues in the docking incompatible connexins (K168V, N176H or K168V-N176H) increased the formation of morphological and functional heterotypic GJs with connexin43 (Cx43) or connexin40 (Cx40), indicating that these two residues are important for docking incompatibility between Cx26 and these connexins. Our homology structure models predict that both HBs and hydrophobic interactions at the E2 docking interface are important docking mechanisms in heterotypic Cx26 K168V-N176H/Cx43 GJs and probably other docking compatible connexins. Revealing the key residues and mechanisms of heterotypic docking compatibility will assist us in understanding why these putative docking residues are hotspots of disease-linked mutants.