Fiducial markers are utilized for image guided radiotherapy (IGRT) alignment during the delivery of liver stereotactic body radiosurgery (SBRT). There are limited data demonstrating the impact of matching fiducials on the accuracy of liver SBRT. This study quantifies the benefit of fiducial-based alignment and improvements in inter-observer reliability. Nineteen patients with 24 liver lesions were treated with SBRT. Target localization was performed using fiducial markers on cone-beam computed tomography (CBCT). Each CBCT procedure was retrospectively realigned to match both the liver edge and fiducial markers. The shifts were recorded by seven independent observers. Inter-observer variability was analyzed by calculating the mean error and uncertainty for the set-up. The mean absolute Cartesian error observed from fiducial and liver edge-based alignment was 1.5 mm and 5.3 mm, respectively. The mean uncertainty from fiducial and liver edge-based alignment was 1.8 mm and 4.5 mm, respectively. An error of 5 mm or greater was observed 50% of the time when aligning to the liver surface versus 5% of the time when aligning to fiducial markers. Aligning to the liver edge significantly increased the error, resulting in increased shifts when compared to alignment to fiducials. Tumors of 3 cm or farther from the liver dome had higher mean errors when aligned without fiducials (4.8 cm vs. 4.4 cm,p= 0.003). Our data support the use of fiducial markers for safer and more accurate liver SBRT.