If you have small kids, have you ever vacationed with your husband leaving the kids behind? My kids aren't too little anymore, but I'm worried about leaving them with my helper.

Personally I feel you should leave them behind. I will bring all my 4 kids where ever I go. Although you may have a helper, you can never be sure that nothing will happen and should it happen, it's too late for regrets. My suggestion if you really want to leave them with the helper, please also get your parents or in laws to look see look see for you at the same time.