New antibiotic caused dizziness

A couple of days ago, I got antibiotics from the pharmacy and was told to start them because I had a throat infection. But on the second day, I started feeling dizzy and nauseous. I'm really uncomfortable. I'm thinking about stopping the medication, but I'm afraid the infection will get worse. What do you suggest I do? Should I go back to the doctor?