Remove mitten and keep rubbing

When did u start remove mitten for LO? I have removed hers for 2 weeks already but alamak she keep pulling her hair, ear and keep rubbing the face until got the red red mark. Anyone encounter same issue as me? My baby now 5weeks