It is not nice to tell them the exact reason if you still wish to maintain a good relationship with the relatives. You can let them know the kids are busy with schoolwork. But for major festival you can bring kids along to have bonding with the extended family members.