Can we have sex during second trimester of pregnancy? Is it safe?

My OB advised that we can still make love but my husband need to withdraw. She told me that sperm can soften the cervix and might dilate causing premature labor or miscarriage