At the beginning of the COVID-19 pandemic, patients with primary and secondary immune disorders—including patients suffering from cancer—were generally regarded as a high-risk population in terms of COVID-19 disease severity and mortality. By now, scientific evidence indicates that there is substantial heterogeneity regarding the vulnerability towards COVID-19 in patients with immune disorders. In this review, we aimed to summarize the current knowledge about the effect of coexistent immune disorders on COVID-19 disease severity and vaccination response. In this context, we also regarded cancer as a secondary immune disorder. While patients with hematological malignancies displayed lower seroconversion rates after vaccination in some studies, a majority of cancer patients’ risk factors for severe COVID-19 disease were either inherent (such as metastatic or progressive disease) or comparable to the general population (age, male gender and comorbidities such as kidney or liver disease). A deeper understanding is needed to better define patient subgroups at a higher risk for severe COVID-19 disease courses. At the same time, immune disorders as functional disease models offer further insights into the role of specific immune cells and cytokines when orchestrating the immune response towards SARS-CoV-2 infection. Longitudinal serological studies are urgently needed to determine the extent and the duration of SARS-CoV-2 immunity in the general population, as well as immune-compromised and oncological patients.