Week 18 and down with fever sore throat

I’m 18 weeks pregnant and down with a fever and sore throat. GP told me to take Panadol, I am so worried the fever will affect baby - any mummies out there delivered healthy babies even though fell sick during pregnancy? Pls help I am so worried