Some people are allergic to penicillin. Symptoms include nausea, diarrhea, or rash. Rarely, patients who are allergic to penicillin get a fever, vomit, or have serious skin irritation. Because it is such a popular antibiotic, penicillin is the most common cause of serious allergic reactions to a drug. They are now used regularly in hospitals.