Polydimethylsiloxane (PDMS) is one of the most widely used polymeric materials for sealants, adhesives, lubricants, and thermal as well as electrical insulation. At low temperatures, however, PDMS is subject to crystallization that can cause deterioration in mechanical function. A common way to suppress such crystallization is through the incorporation of phenylsiloxane into the backbone of polysiloxane. Nevertheless, the introduction of phenyl components, even in small quantities, could potentially change the properties of the siloxane in a significant way. In this work, a series of mechanical tests and finite element simulations were performed to study the macroscale viscoelasticity of two poly(dimethyl-co-diphenyl)siloxane formulations in order to understand the effects of a few percent diphenyl contents on the viscoelasticity of the polysiloxane material. We utilized the small-angle X-ray scattering to investigate the microscopic structures of the copolymers and broadband dielectric spectroscopy and rheology to probe the chain dynamics at the microscale. The results of these characterizations were used to inform the finite element simulations. We found that the degree of cross-linking does not significantly alter the microstructure but can profoundly affect the viscoelastic response of the copolymer networks. The corresponding hysteretic behavior is interpreted in terms of reptation-like motion and relaxation of the effective free chains in the cured polymer network. The relaxation of the copolymer chains is slowed significantly by even a small increase in the molar ratio of the diphenyl component.