if your body can't get enough nutrients from foods, your baby will get it from your body stored-supply.
long term it will deplete your own nutrients stored, so might affect your health too. Good to take on daily basis or as much as you remember them. =)