The ubiquitin-proteasome system (UPS) controls protein turnover, and its dysfunction contributes to human diseases including cancer. Deubiquitinating enzymes (DUBs) remove ubiquitin from proteins to maintain their stability. Inhibition of DUBs could induce the degradation of selected oncoproteins and has therefore become a potential therapeutic strategy for cancer. The deubiquitylase OTUD3 was reported to promote lung tumorigenesis by stabilizing oncoprotein GRP78, implying that inhibition of OTUD3 may be a therapeutic strategy for lung cancer. Here, we report a small-molecule inhibitor of OTUD3 (named OTUDin3) by computer-aided virtual screening and biological experimental verification. OTUDin3 exhibited pronounced antiproliferative and proapoptotic effects by inhibiting deubiquitinating activity of OTUD3 in non-small-cell lung cancer (NSCLC) cell lines. Moreover, OTUDin3 efficaciously inhibited growth of lung cancer xenografts in mice. In summary, our results support OTUDin3 as a potent inhibitor of OTUD3, the inhibition of which may be a promising therapeutic strategy for NSCLC.