For mine, as his job entitles him to PL, he stayed with me thru out till the last day of PL. I can understand where you’re coming from and your feelings are valid. Maybe try to talk to him again to see if can take the time off and accompany you thru out his PL?
Some jobs do require them to go back so maybe compromise to going back for a few days but you will need him with you at the hospital for those 2 days.