If you’re gynae didn’t ask you to refrain or it’s not making you feel uncomfortable (tummy blocking) then it’s ok. It’s normal for your drive to be either high or low (me lol, 17 months and still no feel).
You will probably be too tired to have sex once baby is out (if you have no other help like my situation). If you really want it, probably explain to your husband your needs? If he doesn’t want to have sex, maybe foreplay?