Alzheimer’s disease (AD) is a neurodegenerative disease characterized by progressive cognitive impairment and neuroinflammation. Recent research has revealed the crucial role of gut microbiota and microbial metabolites in modulating AD. However, the mechanisms by which the microbiome and microbial metabolites affect brain function remain poorly understood. Here, we review the literature on changes in the diversity and composition of the gut microbiome in patients with AD and in animal models of AD. We also discuss the latest progress in understanding the pathways by which the gut microbiota and microbial metabolites from the host or diet regulate AD. By understanding the effects of dietary components on brain function, microbiota composition, and microbial metabolites, we examine the potential for manipulation of the gut microbiota through dietary intervention to delay the progression of AD. Although it is challenging to translate our understanding of microbiome-based approaches to dietary guidelines or clinical therapies, these findings provide an attractive target for promoting brain function.