Letting the States set all environmental standards and clean-up is not that simple when there are 48 continental States so close together. Rivers, air and cars cross State borders. Even some cities are split (e.g. Kansas City).

Also, there is only one set of taxpayers. So whether you pay for it through Federal or State taxes it still comes out of your pocket. Economics 101.