Baby is small , try to give room temperature instead. It's best not to give it often at young age as baby adapt to taste fast, especially it's somethings sweet, scare your baby might want something sweet instead of milk.
If after 1 year old, it's fine. A bit cold once awhile is ok. I even give ice-cream when he teething also.
Read more