Is it too much to expect my husband to look after the baby when she cries in night time?

Not at all! A baby is the responsibility of both the parents. Unfortunately, somewhere there is an "unwritten rule" that only the mother should take care of the baby at night and not the father. Other than feeding, the father can do everything else.