Efficient manipulation of thermal conductivity and fundamental understanding of the microscopic mechanisms of phonon scattering in crystalline solids are crucial to achieve high thermoelectric performance. Thermoelectric energy conversion directly and reversibly converts between heat and electricity and is a promising renewable technology to generate electricity by recovering waste heat and improve solid-state refrigeration. However, a unique challenge in thermal transport needs to be addressed to achieve high thermoelectric performance: the requirement of crystalline materials with ultralow lattice thermal conductivity (κ L ). A plethora of strategies have been developed to lower κ L in crystalline solids by means of nanostructural modifications, introduction of intrinsic or extrinsic phonon scattering centers with tailored shape and dimension, and manipulation of defects and disorder. Recently, intrinsic local lattice distortion and lattice anharmonicity originating from various mechanisms such as rattling, bonding heterogeneity, and ferroelectric instability have found popularity. In this Perspective, we outline the role of manipulation of chemical bonding and structural chemistry on thermal transport in various high-performance thermoelectric materials. We first briefly outline the fundamental aspects of κ L and discuss the current status of the popular phonon scattering mechanisms in brief. Then we discuss emerging new ideas with examples of crystal structure and lattice dynamics in exemplary materials. Finally, we present an outlook for focus areas of experimental and theoretical challenges, possible new directions, and integrations of novel techniques to achieve low κ L in order to realize high-performance thermoelectric materials.