Talk it out and tell him how you feel. Life goes on my dear, he have to be supportive and sensitive towards you and not the exs'. It's not wrong to continue being friends but it's not right to not be honest about it either. Don't bottle up the feelings.