Would you restrict your dog/cat to come near your newborn?

I'm a cat lover, but my answer will be yes.. because nb baby is still weak and their immunisations is not strong. I need to let go my 2 cats after my baby 2 months because he got a bad allergic l