Aiming at the problem of the fairness of the judgment results in the traditional basketball referee training and evaluation process affected by external factors, an intelligent system for training and assessment of basketball referees in sports events based on intelligent sensors is proposed. We collect the judged poses of basketball referees by wearing intelligent sensor devices, store the collected information in the database using the converter, and analyze the pose data with the quaternion pose solution method based on complementary filters. According to the comparator, the analysis result is compared with the standard judgment information, and the action is judged whether the action conforms to the basketball judgment rules of the sports event. The judge’s action pose score is evaluated according to the judgment result, and the training assessment result is outputted. The results show that the system can clearly simulate the acceleration and pose angle data of the referee’s complex actions, the recognition rate of various basketball penalty poses is high, and the error of the pitch, yaw, and roll pose calculations is small. The response time of this system is 4 ms, when the number of requests sent by the client is 200 which is unanimously approved by the referees.