Anti-programmed death 1 (PD-1) antibodies have emerged as frontline treatments for patients with advanced non-small cell lung cancer (NSCLC) on the basis of global Phase III trials. However, current data regarding responses to anti-PD-1 therapy in older patients with NSCLC or those with poor performance status (PS) are limited. Therefore, we examined the therapeutic effect of anti PD-1 antibody in these patients. Patients: We retrospectively examined consecutive patients treated with anti-PD-1 monotherapy (pembrolizumab or nivolumab) from January 2016 to September 2018. Results: We enrolled 125 patients (median age, 60 years), 80.8% of whom were men. Patients aged ≥75 years were considered older patients (n = 15), and those with PS 2-3 were regarded as having poor PS (n = 11). The objective response and disease control rates were 15.4% and 46.2%, respectively, in older patients and 9.1% and 27.3%, respectively, in those with poor PS. Progression-free survival (PFS) and overall survival (OS) did not significantly differ between older and younger patients. However, poor PS was significantly associated with poor survival. High programmed death ligand 1 (PD-L1) expression in tumor specimens (≥50%) was associated with favorable survival in the entire cohort as well as patients with poor PS. Safety analyses demonstrated no significant difference in the occurrence of any adverse event, including grade ≥3 adverse events, between patients with poor PS or older age and the remaining patients. Conclusion: Anti-PD-1 therapy had similar efficacy in older and younger patients with NSCLC, whereas survival was significantly worse in patients with poor PS. However, immune checkpoint inhibitors may be considered for patients with poor PS harboring positive PD-L1 expression.