It's alright for some time as your baby really wants to play with her father :) There's no harm in letting her play with him and then going back to sleep again. In fact, it will give your hubby and baby some good time to bond.
Just make sure you give her her naps in the day.