Returning back to work

When is the "right" time to return back to work after giving birth? Sad but true that we miss out on opportunities if we've left work for too long.. Please advise, thank you.