It’s fine not to drink water as baby is still getting milk at this stage. My baby was same, but I didn’t force him to drink water. Over the time when reduced milk he drank water. As long as baby’s not dehydrated or no digestion issues, don’t worry about their water intake.