The paper proposes a 2D-hybrid system of computational intelligence, which is based on the generalized neo-fuzzy neuron. The system is characterised by high approximate abilities, simple computational implementation, and high learning speed. The characteristic property of the proposed system is that on its input the signal is fed not in the traditional vector form, but in the image-matrix form. Such an approach allows getting rid of additional convolution-pooling layers that are used in deep neural networks as an encoder. The main elements of the proposed system are a fuzzified multidimensional bilinear model, additional softmax layer, and multidimensional generalized neo-fuzzy neuron tuning with cross-entropy criterion. Compared to deep neural systems, the proposed matrix neo-fuzzy system contains gradually fewer tuning parameters – synaptic weights. The usage of the time-optimal algorithm for tuning synaptic weights allows implementing learning in an online mode.