Can we drink coffee during confinement?

I did drink but like half a cup and one week like once.. after I read that caffeine not good for baby, I cut for awhile till sometimes cannot take it, then have one cup after pump/ baby latch on