How long should a couple, who's trying really hard for a pregnancy, wait before visiting the fertility specialist?

We tried for 1 year before seeking the expert. We also tried IUI, IVF etc for about 5 years before my little one decide to grow and come out