Hi Tia! Yes you can use it right away, the water inside is sterile din so it's safe for baby, no need to dump it out. A few of us actually just let it cool down a bit and use it agad lalo na kung mainit pa, saves time especially during those 3am feeds hihi. Just make sure the bottle itself is completely dry on the outside before handling para comfortable ka lang.