high fever during 4 months preg

Hi mommies im currently 4 months preg and has a fever of 38.9 with muscle ache, flu n sore throat. Doc couldnt give me any.meds for fever as im allergic, so he only gave me antibiotics (enziththromycin) i think. Should i be worried of the fever? Does it affect my baby? Thank u