Cancer-associated anemia promotes tumor progression, leads to poor quality of life in patients with cancer, and even obstructs the efficacy of immune checkpoint inhibitors therapy. However, the precise mechanism for cancer-associated anemia remains unknown and the feasible strategy to target cancer-associated anemia synergizing immunotherapy needs to be clarified. Here, we review the possible mechanisms of cancer-induced anemia regarding decreased erythropoiesis and increased erythrocyte destruction, and cancer treatment-induced anemia. Moreover, we summarize the current paradigm for cancer-associated anemia treatment. Finally, we propose some prospective paradigms to slow down cancer-associated anemia and synergistic the efficacy of immunotherapy.Video AbstractSupplementary InformationThe online version contains supplementary material available at 10.1186/s12964-023-01145-w.