With the rapid development of the internet of things (IoT) technology, IoT devices have brought great convenience to agriculture, industry, and our daily lives. However, there exist numerous vulnerabilities and lack of efficient protective measures in IoT, thus its devices can be easily infected by malware. It is of great importance to improve the accuracy of malware classification for detecting and preventing the IoT malware. In this article, we adopt the mixture of experts (MoE) neural network to analyze and classify the family of the IoT malware. A classification framework is proposed based on the MoE neural network which utilizes the multitask learning approach and is designed to train multiple neural networks, each of which is responsible for a set of data and tasks. The proposed framework contains three neural networks which are designed to analyze and classify the malware and benignware samples. Especially, an improved hierarchical softmax algorithm based on the MoE neural network is used to distinguish the malware from benignware and get its exact classification. Experiment results show that the presented MoE neural network model can effectively distinguish the malware and benignware. Besides, the MoE neural network is also effective for malware family classification. The comparison of experiment results with other literatures shows that the proposed classification method has better performance.