Depends on individual but caffeine is a milk killer for many. It could also be that the caffeine sis stealing water from u - so u have lesser water to produce the milk with
I cant say it will or will not drop. It totally depends on individual. For example some take papaya soup and supply will increase, whilst it may not for others.