During the REM state, a baby may be moving in conjunction with their dreams ir simplt due ti the activity happening in their brain. All this movement can be noisy. Also your baby may make sounds from gurgle to a whimper in conjuction with their dreams.
Nikhil G Nair