When will it be safe to have sex during pregnancy?

I’m about 12 weeks pregnant. My hubby and myself haven’t have sex for more than 3 months and it’s torturing us. Not sure if it’s the pregnancy that’s making my sex drive higher or it’s too long we haven’t have sex. But my hubby is concerned that he might hurt the baby if we have sex during my pregnancy, so he is a bit reluctant to have sex. Anyone face the same issue as me? I feel bad for not being able to satisfy his needs.