The present study investigates the role of a simple inerter in supplemental devices for possible implementation in the mature seismic base isolation technique. Firstly, the response of the base-isolated structure with an optimally tuned mass damper inerter (TMDI) is investigated to see the tuning effects. The time required to tune the TMDI was found to be significantly longer than the duration of a strong-motion earthquake. There was still a reduction in the response of the isolated structure, which is primarily due to the added damping and stiffness (ADAS) of TMDI and not because of the tuning effects. Hence, it is proposed that the corresponding ADAS of the TMDI be directly added to the isolation device. Secondly, the response of the base-isolated structures to the fluid inerter damper (FID) is studied. It was observed that the inerter of the FID does not influence the displacement variance of an isolated structure under broadband earthquake excitation. It implies that the response of the isolated structure to FID is primarily controlled by its counterpart fluid damper (FD). The performance of optimal TMDI, ADAS, FID, and FD to mitigate the seismic response of the flexible multi-story base-isolated structure under real earthquake excitations is also investigated. In terms of suppressing the displacement and acceleration responses of the isolated structure, it has been found that TMDI and ADAS perform similarly. Comparing the response of the isolated structure with FID and FD demonstrated that the inerter in the FID has detrimental effects on the isolated structures, in which the top floor’s acceleration and base shear are substantially increased.