Electron Beam Powder Bed Fusion (PBF-EB) is an Additive Manufacturing (AM) method that utilizes an electron beam to melt and consolidate metal powder. The beam, combined with a backscattered electron detector, enables advanced process monitoring, a method termed Electron Optical Imaging (ELO). ELO is already known to provide great topographical information, but its capabilities regarding material contrast are less studied. In this article the extents of material contrast using ELO are investigated, focusing mainly on identifying powder contamination. It will be shown that an ELO detector is capable of distinguishing a single 100 μmforeign powder particle, during an PBF-EB process, if the backscattering coefficient of the inclusion is sufficiently higher than its surroundings. Additionally, it is investigated how the material contrast can be used for material characterization. A mathematical framework is provided to describe the relationship between the signal intensity in the detector and the effective atomic numberZeffof the imaged alloy. The approach is verified with empirical data from twelve different materials, demonstrating that the effective atomic number of an alloy can be predicted to within one atomic number from its ELO intensity.