A novel supramolecular building block (8) that consists of a Hamilton receptor and two merocyanine dyes has been synthesized, and the self-assembly based on orthogonal hydrogen bonding and dipolar interactions has been studied in detail. Different self-assembled species, including oligomers, polymers, and inverted micelles could be observed upon variation of the solvent polarity and the concentration. Moreover, this system is highly responsive toward molecular stimuli such as merocyanine molecules with the barbituric acid motif that are bound by the Hamilton receptors. Detailed UV/Vis absorption studies provided insight into isodesmic or cooperative steps during the self-assembly of 8 into different species. The size of the aggregates in solution and the morphology on substrates have been explored by a combination of dynamic light scattering (DLS), atomic force microscopy (AFM), and TEM investigations.