The extraordinary success in laser cooling, trapping, and coherent manipulation of atoms has energized the efforts in extending this exquisite control to molecules. Not only are molecules ubiquitous in nature, but the control of their quantum states offers unparalleled access to fundamental constants and possible physics beyond the Standard Model. Quantum state manipulation of molecules can enable high-precision measurements including tests of fundamental symmetries and searches for new particles and fields. At the same time, their complex internal structure presents experimental challenges to overcome in order to gain sensitivity to new physics. In this Perspective, we review recent developments in this thriving new field. Moreover, throughout the text we discuss many current and future research directions that have the potential to place molecules at the forefront of fundamental science.