Vehicle speed detection and violation detection is in automated way is very useful task for intelligent traffic surveillance system. Vehicle tracking in a precise way is critical task for the process of estimating the speed using only video data. This paper proposes an algorithm to estimate the speed and detecting the violation in precise way. The proposed approach gives the method which contains the optical flow algorithm with corner detection for tracking the vehicle. Proposed algorithm results the better tracking accuracy and better accuracy for speed detection. Also less computation complexity as optical flow is calculated for only corner points.