Disentangling human brain connectivity requires an accurate description of nerve fiber trajectories, unveiled via detailed mapping of axonal orientations. However, this is challenging because axons can cross one another on a micrometer scale. Diffusion magnetic resonance imaging (dMRI) can be used to infer axonal connectivity because it is sensitive to axonal alignment, but it has limited spatial resolution and specificity. Scattered light imaging (SLI) and small-angle X-ray scattering (SAXS) reveal axonal orientations with microscopic resolution and high specificity, respectively. Here, we apply both scattering techniques on the same samples and cross-validate them, laying the groundwork for ground-truth axonal orientation imaging and validating dMRI. We evaluate brain regions that include unidirectional and crossing fibers in human and vervet monkey brain sections. SLI and SAXS quantitatively agree regarding in-plane fiber orientations including crossings, while dMRI agrees in the majority of voxels with small discrepancies. We further use SAXS and dMRI to confirm theoretical predictions regarding SLI determination of through-plane fiber orientations. Scattered light and X-ray imaging can provide quantitative micrometer 3D fiber orientations with high resolution and specificity, facilitating detailed investigations of complex fiber architecture in the animal and human brain.