Guilty to have sex

After learning about my pregnancy my husband feels guilty and almost “wrong” to a certain extend, to have sex with me. First of all he’s worried about the baby being in danger and secondly he just feels that it’s wrong to be aroused knowing there’s a foetus in there. And now he refrains from having intercourse with me as much as he can. I’m just at 9 weeks, and it’s not even showing. Pretty bumped out by this, anyone’s husband reacts the same?