Is this teething?

My son is around 4.5 months now. Drooling quite a bit, always does chewing action, and fussy recently, so we suspected teething and let him chew chilled teether / clean finger massage gum. Any parents to share similar experience?