When should I start saving for my child?

I would say before they are born as well. Saving a bit every month won't feel like a lot at the time, but it will be a very welcome surprise!