Visual attention is often inadvertently captured by salient stimuli. It was suggested that it is possible to prevent attentional capture in some search tasks by suppressing salient stimuli below baseline. Evidence for attentional suppression comes from a probe task that was interleaved with the main search task. In the probe task of Gaspelin et al. (Psychol Sci 26(11):1740–1750, 2015. 10.1177/0956797615597913), letters were shown on the stimuli of the search display and participants had to identify as many letters as possible. Performance was found to be worse for letters shown on the distractor compared to non-salient non-target stimuli, suggesting that distractor processing was suppressed below baseline. However, it is unclear whether suppression occurred at the level of perception or decision-making because participants may have reported letters on the distractor less frequently than letters on nontargets. This decision-level bias may have degraded performance for letters on distractor compared to nontarget stimuli without changing perception. After replicating the original findings, we conducted two experiments where we avoided report bias by cueing only a single letter for report. We found that the difference between distractor and nontarget stimuli was strongly reduced, suggesting that decision-level processes contribute to attentional suppression. In contrast, the difference between target and non-target stimuli was unchanged, suggesting that it reflected perceptual-level enhancement of the target stimuli.Supplementary InformationThe online version contains supplementary material available at 10.1007/s00426-022-01734-3.