The acquisition of the geometry of general scenes is related to the interplay of surface geometry, material properties and illumination characteristics. Surface texture and non-Lambertian reflectance properties degrade the reconstruction results by structured light technique. Existing structured light techniques focus on different coding strategy and light sources to improve reconstruction accuracy. The hybrid system consisting of a structured light technique and photometric stereo combines the depth value with normal information to refine the reconstruction results. In this paper, we propose a novel hybrid system consisting of stripe-based structured light and photometric stereo. The effect of surface texture and non-Lambertian reflection on stripe detection is first concluded. Contrary to existing fusion strategy, we propose an improved method for stripe detection to reduce the above factor’s effects on accuracy. The reconstruction problem for general scene comes down to using reflectance properties to improve the accuracy of stripe detection. Several objects, including checkerboard, metal-flat plane and free-form objects with complex reflectance properties, were reconstructed to validate our proposed method, which illustrates the effectiveness on improving the reconstruction accuracy of complex objects. The three-step phase-shifting algorithm was implemented and the reconstruction results were given and also compared with ours. In addition, our proposed framework provides a new feasible scheme for solving the ongoing problem of the reconstruction of complex objects with variant reflectance. The problem can be solved by subtracting the non-Lambertian components from the original grey values of stripe to improve the accuracy of stripe detection. In the future, based on stripe structured light technique, more general reflection models can be used to model different types of reflection properties of complex objects.