In this paper, we present a two-stage vision-based approach to detect multi views of pedestrian in road scene images. The first stage is HG (Hypothesis Generation), in which potential pedestrian are hypothesized. During the hypothesis generation step, we use a vertical, horizontal edge map, and different colors between road background and pedestrian's clothes to determine the leg position of pedestrian, then a novel symmetry peaks processing is performed to define how many pedestrians is covered in one potential candidate region. Finally, the real candidate region where pedestrian exists will be constructed. The second stage is HV (Hypothesis Verification). In this stage, all hypotheses are verified by Support Vector Machine for classification, which is robust for multi views of pedestrian detection and recognition problems.