Depend individually. I bring my baby 2months old to kl and malacca. Everytime fine. But tiring. Now he is 16 months I bring him for holiday he can't sleep in hotel only in his bed. Eventually he fall sick. Trip was to Cameron and genting. Totally cold during Dec. So it really depends. I am not going for holiday till he is able to speak and adapt.
I feel any holiday with baby is going to be challenging but if you're well prepared you can still enjoy yourself. Find a country with pleasant, cool weather, check the forecast for rain & go during spring season. Japan and Taiwan have nice cool weather during spring and are pretty baby friendly.
After all vaccination try short distance 1st like 3days 2night at bintan batam or JB
Taiwan 5 days