First trimester is important for the development of the baby. But to put your mind at ease, it’s best to consult your doctor and share your working situation and follow what they advice. I know it might be hard to give up and having your husband asking you to stop is very hard too. I would suggest finding a middle ground(if the doctor say you can work) and convert to part time. This way, win-win.