The current standard second-line treatment is immune checkpoint inhibitors monotherapy for nonsmall cell lung cancer (NSCLC) patients. The objective of this phase 2 study was to evaluate the efficacy and safety of nivolumab plus docetaxel compared with nivolumab monotherapy for second-line therapy in immunotherapy-naive patients with advanced NSCLC. Progression-free survival (PFS) was the primary endpoint of this phase 2 study. Patients were randomized to receive nivolumab plus docetaxel or nivolumab monotherapy. From July 2019 to June 2022, a total of 22 patients were recruited, with significantly longer median PFS observed in the nivolumab plus docetaxel group (4.0 months) compared to the nivolumab group (2.0 months), P = 0.0019. The study was closed in June 2022 due to slow recruitment. The objective response rate was 10.0% [95% confidence interval (CI), 0–28.6] in the nivolumab group and 25% (95% CI, 0.5–49.5) in the nivolumab + docetaxel group (P = 0.346). Disease control was significantly higher in the nivolumab plus docetaxel arm (40.0% versus 83.3%, P = 0.035). There was also an improvement in overall survival (OS) in the nivolumab + docetaxel arm, but this was not statistically significant (10.0 months versus 7.2 months, P = 0.129). The addition of docetaxel to nivolumab was well-tolerated, with adverse events more common in the combination group. Despite the small sample size, the results suggest that the addition of docetaxel to nivolumab may be a promising treatment option for NSCLC patients progressing on platinum-based chemotherapy, with trends towards improved OS observed.