Do you have to brush baby's gums even if their teeth haven't emerged yet?

I do not brush their gums as I afraid that it will irritate the gums. I just use boiled water and wash cloth to clean his mouth, tongue and gums. Even till now his first tooth had emerged I'm still using wash cloth to clean.