Damage to the olfactory system can happen through brain injury, cancer or toxic gases. The damage is usually measured by doctors giving the patient something to smell and having the patient try to guess what it is.