BackgroundThere is an unmet need to identify novel predictive biomarkers that enable more accurate identification of individuals who can benefit from immune checkpoint inhibitor (ICI) therapy. The US FDA recently approved tumor mutational burden (TMB) score of ≥ 10 mut/Mb as a threshold for pembrolizumab treatment of solid tumors. Our study aimed to test the hypothesis that specific gene mutation signature may predict the efficacy of ICI therapy more precisely than high TMB (≥ 10).MethodsWe selected 20 candidate genes that may predict for the efficacy of ICI therapy by the analysis of data from a published cohort of 350 advanced non-small cell lung cancer (NSCLC) patients. Then, we compared the influences of various gene mutation signatures on the efficacy of ICI treatment. They were also compared with PD-L1 and TMB. The Kaplan-Meier method was utilized to evaluate the prognosis univariates, while selected univariates were adopted to develop a systematic nomogram.ResultsA high mutation signature, where three or more of the 20 selected genes were mutated, was associated with the significant benefits of ICI therapy. Specifically, patients with high mutation signature were confirmed to have better prognosis for ICI treatment, compared with those with wild type (the median PFS: 7.17 vs. 2.90 months, p = 0.0004, HR = 0.47 (95% [CI]:0.32–0.68); the median OS: unreached vs. 9 months, p = 1.8E-8, HR = 0.17 (95% [CI]:0.11–0.25)). Moreover, those patients with the high mutation signature achieved significant ICI treatment benefits, while there was no difference of OS and PFS between patients without the signature but TMB-H (≥ 10) and those without the signature and low TMB(< 10). Finally, we constructed a novel nomogram to evaluate the efficacy of ICI therapy.ConclusionA high mutational signature with 3 or more of the 20-gene panel could provide more accurate predictions for the outcomes of ICI therapy than TMB ≥ 10 in NSCLC patients.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12890-023-02512-6.