The intake of dietary phosphate far exceeds recommended levels; however, the long-term health consequences remain relatively unknown. Here, the chronic physiological response to sustained elevated and reduced dietary phosphate consumption was investigated in mice. Although serum phosphate levels were brought into homeostatic balance, the prolonged intake of a high-phosphate diet dramatically and negatively impacted bone volume; generated a sustained increase in the phosphate responsive circulating factors FGF23, PTH, osteopontin and osteocalcin; and produced a chronic low-grade inflammatory state in the BM, marked by increased numbers of T cells expressing IL-17a, RANKL, and TNF-α. In contrast, a low-phosphate diet preserved trabecular bone while increasing cortical bone volume over time, and it reduced inflammatory T cell populations. Cell-based studies identified a direct response of T cells to elevated extracellular phosphate. Neutralizing antibodies against proosteoclastic cytokines RANKL, TNF-α, and IL-17a blunted the high-phosphate diet–induced bone loss identifying bone resorption as a regulatory mechanism. Collectively, this study illuminates that habitual consumption of a high-phosphate diet in mice induces chronic inflammation in bone, even in the absence of elevated serum phosphate. Furthermore, the study supports the concept that a reduced phosphate diet may be a simple yet effective strategy to reduce inflammation and improve bone health during aging.