Sarmersbach had its first documentary mention only in 1316, but its founding may be placed in Frankish times in the 9th and 10th centuries. Even earlier than that, however, Celts and Romans had settled the broad fields. Archaeological finds from a small Roman temple in the “Auf den Steinen” area can today be found in the State Museum in Trier. Right near Sarmersbach ran the former Roman road between Trier and Cologne. An ancient indulgence cross, the so-called "Afelskreuz", today stands at a prominent spot, an historical procession point, and nowadays a destination for many hikers and also worshippers.