Imperfect channel state information (I-CSI) and imperfect transceiver hardware often happen in wireless communication systems due to the time-varying and random characteristics of both wireless channels and hardware components. The impacts of I-CSI and hardware impairments (HI) reduce not only the system performance but also the self-interference cancellation (SIC) capability of full-duplex (FD) devices. To investigate the system performance in realistic scenarios, in this paper, we consider the performance of an FD multiple-input multiple-output (MIMO) relay system under the effects of I-CSI, imperfect SIC (I-SIC), and imperfect transceiver hardware. We mathematically derive the exact closed-form expressions of the outage probability (OP) and ergodic capacity of the considered HI-FD-MIMO relay system over Rayleigh fading channels with the existence of I-CSI, I-SIC, and HI. Numerical results indicate that the performance in terms of OP and capacity reaches saturation faster, especially when the channel estimation error, the residual self-interference (RSI), and HI levels are remarkable. Therefore, various solutions for effectively reducing the channel estimation error, RSI, and HI levels in the HI-FD-MIMO relay system should be carried out to improve the system performance. All derived mathematical expressions are verified through Monte-Carlo simulations.