Baby milk cue during midnight

Hi all.. how to know when you baby wants milk during midnight? My Nb always grunt so I thought that he wanted milk but when I tried to feed him, he doesnt want to open his mouth and continue to sleep.