In this paper, for color face‐image recognition, we adopt a system based on the nonzero‐order joint‐transform correlator and use the method of Lagrange multipliers to design the reference functions. Some different facial expressions are utilized as test images to study the discrimination capability. Additionally, random noise is added to the test images in order to investigate the effectiveness of the proposed technique. © 2004 Wiley Periodicals, Inc. Microwave Opt Technol Lett 42: 234–237, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/mop.20262