This paper describes an automatic a new road sign interpretation method using matching pursuit (MP) filters. There are two processes. The detection process finds the relative position of road sign in the original distant image and then extract the internal content of road sign from the closer view image. The recognition process consists of two stages: training and testing. In the first stage, it finds a set of best MP filter bases for each road sign. In the second stage, it projects the input unknown road sign to different set of the MP filter bases to find the best match.