Arbuscular Mycorrhizal Fungi (AMF) constitute a ubiquitous group of soil microorganisms, affecting plant and soil microorganism growth. Various crop management practices can have a significant impact on the AM association. This study investigated the AMF inoculation contribution on growth and productivity of two-rowed barley crop by identifying the underlying mechanisms both in conventional and organic cropping systems. A two-year field trial was set up as a split-plot design with 2 main plots [AMF inoculation: with (AMF+) and without (AMF−)] and five sub-plots (fertilization regimes: untreated, 100% recommended dose of fertilizer in organic and inorganic form, and 60% recommended dose of fertilizer in organic and inorganic form) in three replications. According to the results, AMF+ plants presented higher plant height and leaf area index (LAI), resulting in increased biomass and, as a result, higher seed yield. With regard to the quality traits, including the nitrogen and phosphorus uptake and their utilization indices, the AMF inoculated plants showed higher values. Furthermore, the level of fertilization, particularly in an inorganic form, adversely affected AMF root colonization. Consequently, it was concluded that substitution of inorganic inputs by organic, as well as inputs reduction, when combined with AMF inoculation, can produce excellent results, thus making barley crop cultivation sustainable in Mediterranean climates.