Can you switch formula brands? My friends tell me I shouldn't.

We tried karihome goats milk for newborn but baby rejected it. So we stuck to Bellamy