Another common thing: check if the motherboard isn't making contact (short-circuit) with the case! It is possible that by installing or removing the sound card the mobo now touches somewhere a metal part making some fuzzy connections.

floppy drive -> indeed classical
also try reseating the videocard, is it PCI or AGP?
can you test your psu with another mobo/cpu combination?