Can I drink tea during my first trimester?

I am an avid tea drinker before my pregnancy and I understand that drinking too much caffeine will cause harm to the baby? However to abstain totally from tea is so tough. Does everyone abstains from tea as well or perhaps limit to 1 cup per day? Thanks!