Surveillance streams coded by H.264/SVC (scalable video coding), which consist of one base layer and one or multiple enhancement layers, support flexible and various quality, resolution, and temporal scalabilities such that clients with different network bandwidth and terminal devices can seamlessly access them. In this paper, based on characteristics of SVC layer and surveillance sequences, we present an efficient and hybrid authentication scheme to ensure the integrity of SVC surveillance streams, named AUSSS (Authenticating SVC Surveillance Streams). Distinguished from the existing schemes, AUSSS exploits both cryptographic-based authentication and content-based authentication. Compared to existing authentication schemes, experimental results demonstrate that AUSSS causes less computation complexity and smaller compression overhead.