As an effective method for diagnosis reasoning, fuzzy reasoning is hard to meet the real-time challenge for its complex process and time-consuming. According to the principle of conventional fuzzy reasoning with software, a new method to design expert system fuzzy reasoning with CPLD for fault diagnosis is presented. In the new method, fuzzy operating is realized by function transform with ROM, and CPLD provides logic control and process coordination for fuzzy reasoning. After all, the whole fuzzy reasoning is finished with hardware, not software. It is validated by many experiments that the speed of fuzzy reasoning with this method is faster than traditional modes, and it can be applicable to many on-line diagnosis systems based on single-chip controller or DSP (Digital Signal Processor).