A Mercedes hit cables and conductors in the city centre, with a man, 32, arrested on suspicion of drink driving.
The incident happened early Sunday morning with an electrical box catching fire after being hit.
A Western Power Distribution spokesman said power to most homes was restored within five minutes.
Power to 7,600 Swansea homes was cut off after a car crashed into an electricity substation.