I'm not sure how/why lust got tied to sex, but that's not the case.
A person can lust for a lot of stuff that's harmful that has nothing to do with sex. 
Attention.
Power.
Food.
Entertainment.
I'd say lust is a harmful desire that when attained brings temporary refreshment.