The development in the field of high refractive index materials is a crucial factor for the advancement of optical devices with advanced features such as image sensors, optical data storage, antireflective coatings, light-emitting diodes, and nanoimprinting. Sulfur plays an important role in high refractive index applications owing to its high molar refraction compared to carbon. Sulfur exists in multiple oxidation states and can exhibit various stable functional groups. Over the last few decades, sulfur-containing polymers have attracted much attention owing to their wide array of applications governed by the functional group of sulfur present in the polymer repeat unit. The interplay of refractive index and various other polymer properties contributes to successfully implementing a specific polymer material in optical applications. The focus on developing optoelectronic devices induced an ever-increasing need to integrate different functional materials to achieve the devices' full potential. Several devices that see the potential use of sulfur in high refractive index materials are reviewed in the study. Like sulfur, selenium also exhibits high molar refraction and unique chemical properties, making it an essential field of study. This review covers the research and development in the field of sulfur and selenium in different forms of functionality, focusing on the chemistry of bonding and the optical properties of the polymers containing the heteroatoms mentioned above. The strategy and rationale behind incorporating heteroatoms in a polymer matrix to produce highrefractive-index materials are also described in the present review.