Hematopoietic stem cells (HSCs) are defined based on their capacity to replenish themselves (self-renewal) and give rise to all mature hematopoietic cell types (multi-lineage differentiation) over their lifetime. HSCs are mainly distributed in the bone marrow during adult life, harboring HSC populations and a hierarchy of different kinds of cells contributing to the “niche” that supports HSC regulation, myelopoiesis, and lymphopoiesis. In addition, HSC-like progenitors, innate immune cell precursors such as macrophages, mast cells, natural killer cells, innate lymphoid cells, and megakaryocytes and erythrocyte progenitor cells are connected by a series of complex ontogenic relationships. The first source of mast cells is the extraembryonic yolk sac, on embryonic day 7. Mast cell progenitors circulate and enter peripheral tissues where they complete their differentiation. Embryonic mast cell populations are gradually replaced by definitive stem cell-derived progenitor cells. Thereafter, mast cells originate from the bone marrow, developing from the hematopoietic stem cells via multipotent progenitors, common myeloid progenitors, and granulocyte/monocyte progenitors. In this review article, we summarize the knowledge on mast cell sources, particularly focusing on the complex and multifaceted mechanisms intervening between the hematopoietic process and the development of mast cells.