I feel any holiday with baby is going to be challenging but if you're well prepared you can still enjoy yourself. Find a country with pleasant, cool weather, check the forecast for rain & go during spring season. Japan and Taiwan have nice cool weather during spring and are pretty baby friendly.