Removing mittens

Will it leave scarring on baby face when they stratch their face at times? as I have remove his mittens since he is close to three months old