The coronavirus disease 2019 (COVID-19) pandemic, caused by severe acute respiratory syndrome coronavirus (SARS-CoV-2), has affected all countries worldwide. Although some symptoms are relatively mild, others are still associated with severe and even fatal clinical outcomes. Innate and adaptive immunity are important for the control of SARS-CoV-2 infections, whereas a comprehensive characterization of the innate and adaptive immune response to COVID-19 is still lacking and the mechanisms underlying immune pathogenesis and host predisposing factors are still a matter of scientific debate. Here, the specific functions and kinetics of innate and adaptive immunity involved in SARS-CoV-2 recognition and resultant pathogenesis are discussed, as well as their immune memory for vaccinations, viral-mediated immune evasion, and the current and future immunotherapeutic agents. We also highlight host factors that contribute to infection, which may deepen the understanding of viral pathogenesis and help identify targeted therapies that attenuate severe disease and infection.