In recent years, Immune checkpoint inhibitors have been extensively used in the treatment of a variety of cancers. However, the response rates ranging from 13% to 69% depending on the tumor type and the emergence of immune-related adverse events have posed significant challenges for clinical treatment. As a key environmental factor, gut microbes have a variety of important physiological functions such as regulating intestinal nutrient metabolism, promoting intestinal mucosal renewal, and maintaining intestinal mucosal immune activity. A growing number of studies have revealed that gut microbes further influence the anticancer effects of tumor patients through modulation of the efficacy and toxicity of immune checkpoint inhibitors. Currently, faecal microbiota transplantation (FMT) have been developed relatively mature and suggested as an important regulator in order to enhance the efficacy of treatment. This review is dedicated to exploring the impact of differences in flora composition on the efficacy and toxicity of immune checkpoint inhibitors as well as to summarizing the current progress of FMT.