I stayed with in laws when I had my confinement back then, so my own family came to visit. They understand that I just gave birth and their main motive is to see baby so they limited their visit to 1 hour.
I stayed in my room the entire time and since baby is asleep, they just look at her in her cot. When she’s awake, they took turns carrying her then returned her to me.
Talk to your husband if you are not ready for visitations, he should be the one facing his family and backing up for his wife’s decision. Tell him baby haven’t gotten any jabs yet and you wouldn’t like to risk any germs infecting baby with all the visitations.