Yes. You should breastfeed him/her even more frequent to give antibodies so baby can recover faster from roseola fever. If baby feels very itchy you can apply some calamine lotion on the rashes. If the rashes do not subside after 3 days bring baby to visit doctor.