Bottle warmer

Is it a necessity to purchase the bottle warmer machine? If not, how do you heat up your frozen milk storage or make milk from a powdered formula?