How about having a separate account for the money he gives you?
From that amount, portion an amount for his personal expenditure and use the remaining for all the household-related expenditures. Use your personal savings for your own spending.
This way, you need not explain anything with regard to how you've spend the money. Whatever that remains could be used as budget for family vacations. ;p
I'm adapting from having a joint account for household spending.
Finances are tricky but I do think that it is a good way to track and manage the household spending. You can also contribute to that account so that the expenses are shared. Just my two cents! :)
Read more