First time parents? Life is totally different with the arrival of a baby.
I’m guessing that both of you are exhausted, thus short tempered. Get help to care for the baby and you two go for a dinner break at a restaurant.
Support one another in house chores and parenting. Give in for the sake of your baby. Talk when both are more relaxed and calm.