For semiconductor manufacturing, automatic optical inspections (AOIs) are important for chip quality inspection. An AOI system contains a robot arm, an industrial camera, a x-y platform, and a visual inspection module. Using the industrial camera, a wafer map can be obtained and then sent to the visual inspection module to compare with qualified chip features. There is a baseline in the x-y platform. Due to the limitations of the robot arm flexibility, it is difficult for the robot arm to control the angles between the chip orientation and the baseline every time, which decreases the defect recognition accuracy. This work aims to improve the defect recognition accuracy and efficiency of the AOI system. Specifically, an efficient method is presented to calculate the angle between the baseline and chip orientation. Then, the wafer map can be rotated, such that the angle equals to zero. Further, a powerful system is established to recode the rotated chip coordinate, such that the unqualified chip positions can be located efficiently. This method is called a central array method. The central array method with deep learning methods forms an AI-based AOI system. Extensive experiments demonstrate that our proposed method performs well in improving the chip quality inspection efficiency and accuracy. Nevertheless, the proposed method still has challenges in implementation since it requires integration with the manufacturing line.