Is it normal for a 3 months old baby to drool a lot? I thought babies only drool when they are teething?

Yes, it's normal. Teething not necessarily must have teeth. The gums so needs to prepare itself for teeth growth too.