Hi mum! i can understand especially when you're already 20 weeks along and every little discomfort feels so worrying. A stiff neck with pain when swallowing, even without fever, is something I would not just wait out during pregnancy, so please do bring this up with your gynae or a doctor as soon as you can, just to be safe. They will be able to check properly and give you the right advice for your stage of pregnancy.