he 'd had to be very careful about the women he went out in public with because too many of them wanted him for either his money or his connections , not to mention the publicity they hoped to gain by being seen on his arm .