Is the rule of thumb the same for coffee as it is for alcohol (wait 2 hours before feeding baby)?

Yes, caffeine contain will be peak in your body 1-2hours after consumption. However, do look out for any reaction of baby due to your caffeine intake. http://kellymom.com/bf/can-i-breastfeed/lifestyle/caffeine/ Is baby sensitive to my caffeine intake? According to the Breastfeeding Answer Book (LLLI 2003, p. 599-600), excessive caffeine consumption by the mother (more than 750 mL per day) can result in a baby who shows signs of caffeine stimulation. “A baby who is being overstimulated by caffeine is a wide-eyed, active, alert baby who doesn’t sleep for long. He may also be unusually fussy.” If your baby seems particularly wakeful or fussy and there is a significant amount of caffeine in your diet, you might want to cut back or stop the caffeine for 2-3 weeks to see if it makes a difference. If you cut out caffeine, consider decreasing it slowly since abruptly stopping caffeine can result in headaches or other symptoms. If caffeine stimulation is a problem for baby, it may take a few days to a week after mom eliminates caffeine for baby to become less fussy.