US markets were closed on Monday for the Independence Day holiday.
The Dow Jones fell 108.75 points to 17840.62. The S&P 500 index slid 14.40  points to 2088.55, while the Nasdaq dropped 39.67 points to 4822.90.
Oil prices fell by 4%. The price of a barrel of Brent crude dropped to $48.10 and US crude fell to $46.76.
Shares in Southwestern Energy fell over 10% and Chesapeake Energy lost 6.3%.
Bank stocks continued the downward trend that started after the Brexit vote, with JP Morgan Chase sliding 2.8% and Goldman Sachs losing 2.6%
"Brexit is a friction on economic activity and that's bad for banks," said Brian Battle, director of trading at Performance Trust Capital Partners.
Among the winners was online gaming company Zynga, which climbed 3.9%.
Netflix shares climbed 1.3% after it announced a deal with cable and internet provider Comcast to make Netflix services available through Comcast's set-top boxes.
Comcast shares were down 0.4%.
(Closed): Stocks on Wall Street fell on Tuesday as the uncertainty surrounding the UK's vote to leave the EU continued to unsettle investors.