Take pacifier out when sleeping or leave it

Hi mummies, when your baby is sleeping with pacifier on, do you take it out once they’re asleep or leave it ? Sometimes my baby is sleeping and still sucking every now and then idk to take it out or not