Is it a fact that drinking ginseng will cause decreased supply of breastmilk?

Oh definitely avoid ginseng if you are breastfeeding -- not only will it decrease supply, it can also cause harm to the baby via nursing. In fact there have been reports of death and defects on unborn babies due to their mothers' ginseng intake.