spectral imaging (radiography) spectral imaging (radiography) spectral imaging is an umbrella term for energy-resolved x-ray imaging in medicine. the technique makes use of the energy dependence of x-ray attenuation to either increase the contrast-to-noise ratio, or to provide quantitative image data and reduce image artefacts by so-called material decomposition. dual-energy imaging, i.e. imaging at two energy levels, is a special case of spectral imaging and is still the most widely used terminology, but the terms "spectral imaging" and "spectral ct" have been coined to acknowledge the fact that photon-counting detectors have the potential for measurements at a larger number of energy levels. background the first medical application of spectral imaging appeared in 1953 when b. jacobson at the karolinska university hospital, inspired by x-ray absorption spectroscopy, presented a method called "dichromography" to measure the concentration of iodine in x-ray images. in the 70’s, spectral computed tomography (ct) with exposures at two different voltage levels was proposed by g.n. hounsfield in his landmark ct paper. the technology evolved rapidly during the 70’s and 80’s, but technical limitations, such as motion artifacts, for long held back widespread clinical use. in recent years, however, two fields of technological breakthrough have spurred a renewed interest in energy-resolved imaging. firstly, single-scan energy-resolved ct was introduced for routine clinical use in 2006 and is now available by several major manufacturers, which has resulted in a large and expanding number of clinical applications. secondly, energy-resolving photon-counting detectors start to become available for clinical practice; the first commercial photon-counting system was introduced for mammography in 2003, and ct systems are at the verge of being feasible for routine clinical use. spectral image acquisition an energy-resolved imaging system probes the object at two or more photon energy levels. in a generic imaging system, the projected signal in a detector element at energy level ω ∈ { e 1 , e 2 , e 3 , … } ,e_,e_,\ldots \}} is n ω = q ω ∫ φ ω ( e ) × exp ⁡ [ − μ 1 ( e ) t 1 − μ 2 ( e ) t 2 − μ 3 ( e ) t 3 … ] × γ ω ( e ) d e , =q_\int \phi _(e)\times \exp\times \gamma _(e)\,de,} (1) where q is the number of incident photons, φ is the normalized incident energy spectrum, and γ is the detector response function. linear attenuation coefficients and integrated thicknesses for materials that make up the object are denoted μ and t (attenuation according to lambert–beers law). two conceivable ways of acquiring spectral information are to either vary q × φ with ω , or to have ω -specific γ , here denoted incidence-based and detection-based methods, respectively. linear attenuation as a function of photon energy. the attenuation of a typical human head consisting of 10% bone and 90% brain tissue is decomposed into photo-electric + compton bases (blue) and polyvinyl chloride (pvc) + polyethylene bases (red). the linear attenuation of iodine illustrates the effect of a contrast material with a k absorption edge at 33.2 kev. most elements appearing naturally in human bodies are of low atomic number and lack absorption edges in the diagnostic x-ray energy range. the two dominating x-ray interaction effects are then compton scattering and the photo-electric effect, which can be assumed to be smooth and with separable and independent material and energy dependences. the linear attenuation coefficients can hence be expanded as μ ( e ) = a p e × f p e ( e ) + a c × f c ( e ) . \times f_(e)+a_\times f_(e).} (2) in contrast-enhanced imaging, high-atomic-number contrast agents with k absorption edges in the diagnostic energy range may be present in the body. k-edge energies are material specific, which means that the energy dependence of the photo-electric effect is no longer separable from the material properties, and an additional term can be added to eq. (2) according to μ ( e ) = a p e × f p e ( e ) + a c × f c ( e ) + ∑ a k × f k ( e ) , \times f_(e)+a_\times f_(e)+\sum a_\times f_(e),} (3) where a k and f k are the material coefficient and energy dependency of contrast-agent material k . energy weighting summing the energy bins in eq. (1) ( n = ∑ n ω ) yields a conventional non-energy-resolved image, but because x-ray contrast varies with energy, a weighted sum ( n = ∑ w ω × n ω \times n_ ) optimizes the contrast-to-noise-ratio (cnr) and enables a higher cnr at a constant patient dose or a lower dose at a constant cnr. the benefit of energy weighting is highest where the photo-electric effect dominates and lower in high-energy regions dominated by compton scattering (with weaker energy dependence). energy weighting was pioneered by tapiovaara and wagner and has subsequently been refined for projection imaging and ct with cnr improvements ranging from a few percent up to tenth of percent for heavier elements and an ideal ct detector. an example with a realistic detector was presented by berglund et al. who modified a photon-counting mammography system and raised the cnr of clinical images by 2.2–5.2%. material decomposition equation (1) can be treated as a system of equations with material thicknesses as unknowns, a technique broadly referred to as material decomposition. system properties and linear attenuation coefficients need to be known, either explicitly (by modelling) or implicitly (by calibration). in ct, implementing material decomposition post reconstruction (image-based decomposition) does not require coinciding projection data, but the decomposed images may suffer from beam-hardening artefacts because the reconstruction algorithm is generally non-reversible. applying material decomposition directly in projection space instead (projection-based decomposition), can in principle eliminate beam-hardening artefacts because the decomposed projections are quantitative, but the technique requires coinciding projection data such as from a detection-based method. in the absence of k-edge contrast agents and any other information about the object (e.g. thickness), the limited number of independent energy dependences according to eq. (2) means that the system of equations can only be solved for two unknowns, and measurements at two energies ( | ω | = 2 ) are necessary and sufficient for a unique solution of t 1 and t 2 . materials 1 and 2 are referred to as basis materials and are assumed to make up the object; any other material present in the object will be represented by a linear combination of the two basis materials. material-decomposed images can be used to differentiate between healthy and malignant tissue, such as micro calcifications in the breast, ribs and pulmonary nodules, cysts, solid tumors and normal breast tissue, posttraumatic bone bruises (bone marrow edema) and the bone itself, different types of renal calculi (stones), and gout in the joints. the technique can also be used to characterize healthy tissue, such as the composition of breast tissue (an independent risk factor for breast cancer) and bone-mineral density (an independent risk factor for fractures and all-cause mortality). finally, virtual autopsies with spectral imaging can facilitate detection and characterization of bullets, knife tips, glass or shell fragments etc. the basis-material representation can be readily converted to images showing the amounts of photoelectric and compton interactions by invoking eq. (2), and to images of effective-atomic-number and electron density distributions. as the basis-material representation is sufficient to describe the linear attenuation of the object, it is possible to calculate virtual monochromatic images, which is useful for optimizing the cnr to a certain imaging task, analogous to energy weighting. for instance, the cnr between grey and white brain matter is maximized at medium energies, whereas artefacts caused by photon starvation are minimized at higher virtual energies. k-edge imaging in contrast-enhanced imaging, additional unknowns may be added to the system of equations according to eq. (3) if one or several k absorption edges are present in the imaged energy range, a technique often referred to as k-edge imaging. with one k-edge contrast agent, measurements at three energies ( | ω | = 3 ) are necessary and sufficient for a unique solution, two contrast agents can be differentiated with four energy bins ( | ω | = 4 ), etc. k-edge imaging can be used to either enhance and quantify, or to suppress a contrast agent. enhancement of contrast agents can be used for improved detection and diagnosis of tumors, which exhibit increased retention of contrast agents. further, differentiation between iodine and calcium is often challenging in conventional ct, but energy-resolved imaging can facilitate many procedures by, for instance, suppressing bone contrast and improving characterization of atherosclerotic plaque. suppression of contrast agents is employed in so-called virtual unenhanced or virtual non-contrast (vnc) images. vnc images are free from iodine staining (contrast-agent residuals), can save dose to the patient by reducing the need for an additional non-contrast acquisition, can improve radiotherapy dose calculations from ct images, and can help in distinguishing between contrast agent and foreign objects. most studies of contrast-enhanced spectral imaging have used iodine, which is a well-established contrast agent, but the k edge of iodine at 33.2 kev is not optimal for all applications and some patients are hypersensitive to iodine. other contrast agents have therefore been proposed, such as gadolinium (k edge at 50.2 kev), nanoparticle silver (k edge at 25.5 kev), zirconium (k edge at 18.0 kev), and gold (k edge at 80.7 kev). some contrast agents can be targeted, which opens up possibilities for molecular imaging, and using several contrast agents with different k-edge energies in combination with photon-counting detectors with a corresponding number of energy thresholds enable multi-agent imaging. technologies and methods incidence-based methods obtain spectral information by acquiring several images at different tube voltage settings, possibly in combination with different filtering. temporal differences between the exposures (e.g. patient motion, variation in contrast-agent concentration) for long limited practical implementations, but dual-source ct and subsequently rapid kv switching have now virtually eliminated the time between exposures. splitting the incident radiation of a scanning system into two beams with different filtration is another way to quasi-simultaneously acquire data at two energy levels. detection-based methods instead obtain spectral information by splitting the spectrum after interaction in the object. so-called sandwich detectors consist of two (or more) detector layers, where the top layer preferentially detects low-energy photons and the bottom layer detects a harder spectrum. detection-based methods enable projection-based material decomposition because the two energy levels measured by the detector represent identical ray paths. further, spectral information is available from every scan, which has work-flow advantages. the currently most advanced detection-based method is based on photon-counting detectors. as opposed to conventional detectors, which integrate all photon interactions over the exposure time, photon-counting detectors are fast enough to register and measure the energy of single photon events. hence, the number of energy bins and the spectral separation are not determined by physical properties of the system (detector layers, source / filtration etc.), but by the detector electronics, which increases efficiency and the degrees of freedom, and enable elimination of electronic noise. the first commercial photon-counting application was the microdose mammography system, introduced by sectra mamea in 2003 (later acquired by philips), and spectral imaging was launched on this platform in 2013. the microdose system was based on silicon strip detectors, a technology that has subsequently been refined for ct with up to eight energy bins. silicon as sensor material benefit from high charge-collection efficiency, ready availability of high-quality high-purity silicon crystals, and established methods for test and assembly. the relatively low photo-electric cross section can be compensated for by arranging the silicon wafers edge on, which also enables depth segments. cadmium telluride (cdte) and cadmium–zinc telluride (czt) are also being investigated as sensor materials. the higher atomic number of these materials result in a higher photo-electric cross section, which is advantageous, but the higher fluorescent yield degrades spectral response and induces cross talk. manufacturing of macro-sized crystals of these materials have so far posed practical challenges and leads to charge trapping and long-term polarization effects (build-up of space charge). other solid-state materials, such as gallium arsenide and mercuric iodide, as well as gas detectors, are currently quite far from clinical implementation. the main intrinsic challenge of photon-counting detectors for medical imaging is pulse pileup, which