The inerter is a two-terminal component that can be added to the spring-and-damper configuration of a suspension system. It has the property that the force exerted is proportional to the relative acceleration at its terminals. Studies have demonstrated the inerter’s benefit of providing superior vibration isolation when it is used in the vehicle suspension of passenger cars. However, similar benefit on another common vehicle class on the roads, namely heavy vehicles, remain to be shown, as these vehicles have vastly different parameter values than passenger cars. This study is an investigation on the performance improvement brought by an inerter in the suspension of common heavy vehicles. In the study, the parameter values of a truck and a bus were adopted in the quarter vehicle model with two different spring-damper-inerter configurations (parallel and serial inerter), and the improvements in vibration isolation and road holding capability were determined by optimization of inertance. Results show that the inerter is similarly effective in providing the said improvements when implemented on heavy vehicles instead of on passenger cars, judging from reductions in sprung mass acceleration and dynamic tire load. It is also observed that the performance benefit is associated with larger optimum inertance than that for passenger cars. Overall, the inerter has been shown to be beneficial in the parallel and serial configurations, both of which are common and can be practically implemented in the suspension of heavy vehicles.