Immune-checkpoint inhibitors (ICIs) are reshaping the prognosis of many cancer types and are progressively becoming a standard of care for many of them. Cancer immunotherapy has started a revolution in the oncology therapeutic landscape, bringing new hope to patients but also a whole new spectrum of toxicities for practitioners to manage. Oncologists and specialists involved in the pluridisciplinary management of immune-related adverse events (irAEs) are increasingly confronted with the therapeutic challenge of severe and/or refractory cases. In this personal view, we summarize the therapeutic strategies reported to manage them. Based on current knowledge of irAE pathogenesis and our immunological expertise, we also transpose the use of new biologic and non-biologic immunosuppressive agents, used to treat primary autoimmune disorders (AIDs), in the context of severe and/or steroid refractory irAE management. Depending on the immune-type predominant infiltrate, we propose a personalized treatment algorithm beyond corticosteroids. A shut-off strategy, intended to treat severe or steroid-refractory irAEs, based on the efficient inhibition of key inflammatory components involved in their pathophysiological processes, and limit potential adverse effects of drug immunosuppression on tumor response is proposed. This approach goes beyond current guidelines, challenging the step-by-step increase in drug immunosuppression proposed so far.