He was dark tan from many months, maybe years, in the desert but naturally fair skinned.
His skin was naturally light but had been tanned from a long time in the desert. 
The man's skin remained light despite many years spent in the desert.