The lyrics speak of a compulsive horse-track gambler who compares his addiction for horses with his attraction to women.
The lyrics speak of someone who is helplessly drawn to horse racing, likening this attraction to their desire for women.