When to start using only pregnancy-safe products?

I’m 4+ weeks in and I was told I cannot use certain facial products including some sunscreen because of harmful chemicals. At which week did you start doing so?