The paper presents the results of tensile adhesion strength measurements of ceramic tile adhesive (CTA) stored in various conditions performed by ten operators in one laboratory using the same equipment and auxiliary materials. The obtained results allowed the authors to estimate the repeatability and reproducibility of the tensile adhesion strength measurement method using the methodology following ISO 5725-2:1994+AC1:2002. Standard deviations of repeatability ranging from 0.09 to 0.15 for the general means value in the range of 0.89–1.76 MPa and standard deviations of reproducibility ranging from 0.14 to 0.21 for the same general means content indicate that the accuracy of tensile adhesion strength measurement method is not high enough. From the group of ten operators, five perform tensile adhesion strength measurements daily, the remaining five perform other measures, and the results obtained by professionals and non-professionals showed no significant differences. In light of the obtained results, compliance assessment with this method with the criteria set out in the harmonized standard EN 12004:2007+A1:2012 carried out by different operators may be divergent, and there is a significant risk of incorrect assessments. This risk is additionally increasing in the case of the evaluation conducted by market surveillance authorities, which use the simple acceptance rule that does not consider measurement variability.