Sometimes, the treatment for syphilis can cause a side effect called the Jarisch-Herxheimer reaction. This reaction usually starts within one hour after treatment begins, and lasts for 24 hours. Its symptoms include fever, muscle pains, headache, and a fast heart rate.