Why does my 4 month baby cries (at times)when I make him to sleep?

But when my hubby n helper does it he’s less fussy.. so whenever I carried him n he’s crying, my hubby will ask me to pass to him or pass to my helper cuz he can’t hear baby cries for long. I felt disappointed with my hubby and upset over this it seems like my baby hates me