The human immune repertoire retains the molecular memory of a very great diversity of target antigens (epitopes) and can recall this upon a second encounter with epitopes against which it has previously been primed. Although genetically diverse, proteins of coronaviruses exhibit sufficient conservation to lead to antigenic cross-reactions. In this review, our goal is to question whether pre-existing immunity against seasonal human coronaviruses (HCoVs) or exposure to animal CoVs has influenced the susceptibility of human populations to SARS-CoV-2 and/or had an impact upon the physiopathological outcome of COVID-19. With the hindsight that we now have regarding COVID-19, we conclude that although antigenic cross-reactions between different coronaviruses exist, cross-reactive antibody levels (titers) do not necessarily reflect on memory B cell frequencies and are not always directed against epitopes which confer cross-protection against SARS-CoV-2. Moreover, the immunological memory of these infections is short-term and occurs in only a small percentage of the population. Thus, in contrast to what might be observed in terms of cross-protection at the level of a single individual recently exposed to circulating coronaviruses, a pre-existing immunity against HCoVs or other CoVs can only have a very minor impact on SARS-CoV-2 circulation at the level of human populations.