Following the completion of an adaptive evolution experiment, fitness evaluations are routinely conducted to assess the magnitude of adaptation. In doing so, proper consideration should be given when determining the appropriate methods as trade-offs may exist between accuracy and throughput. Here, we present three instances in which small changes in the framework or execution of fitness evaluations significantly impacted the outcomes. The first case illustrates that discrepancies in fitness conclusions can arise depending on the approach to evaluating fitness, the culture vessel used, and the sampling method. The second case reveals that variations in environmental conditions can occur associated with culture vessel material. Specifically, these subtle changes can greatly affect microbial physiology leading to changes in the culture pH and distorting fitness measurements. Finally, the last case reports that heterogeneity in CFU formation time can result in inaccurate fitness conclusions. Based on each case, considerations and recommendations are presented for future adaptive evolution experiments.Supplementary InformationThe online version contains supplementary material available at 10.1007/s00239-022-10087-9.