This article examines differing approaches to the definition, classification and modelling of interactive music systems, drawing together both historical and contemporary practice. Concepts of shared control, collaboration and conversation metaphors, mapping, gestural control, system responsiveness and separation of interface from sound generator are discussed. The article explores the potential of interactive systems to facilitate the creation of dynamic compositional sonic architectures through performance and improvisation.