Functional dyes exhibit intriguing properties in response to external stimuli related to their optical, electronic, structural, and energetic characteristics and enable unique stimuli-responsive functions in materials by collaborating with polymers, particularly when chemically incorporated into the polymer structures. As well as the structures and properties of functional dyes, polymers, assemblies, and materials, the interactions between these components are important to the functions of materials. In this review, we introduce our recent studies conducted in the past half decade on stimuli-responsive smart polymers and polymeric materials based on functional dyes that are chemically incorporated into the polymer structures, with a special focus on light, force, electric fields, and chemicals including water in a variety of external stimuli. For example, these polymers and materials offer switchable adhesion, mechanical actuation, and chemical sensing.