kennedy isolated himself with an iron circle of friends , making himself unapproachable , while his brother wielded enormous power as attorney general , destroying contacts in organized crime once protected by hoover and the fbi .