In recent years, image encryption has attracted much attention. Particularly, due to large data capacity and high correlation among pixels, chaos-based image encryption algorithms are more suitable to be applied in the digital image encryption. In this paper, we propose a novel chaotic image encryption algorithm, in which novel multiple chaotic systems and efficient self-adaptive model are initially mingled to enhance the security. Different from conventional algorithms, plaintext participates in the generation of cryptograph in a new way, which follows the idea from the perceptron model. The proposed algorithm enlarges the key space, enhances the randomness of the algorithm, and resists the differential attack effectively. Simulation results are demonstrated that proposed algorithm possesses the high security for the main current attacks, which is an excellent candidate for practical applications of image encryption.