Well, in all honesty, I think you can afford the time if it's your first child. Considering he/she won't be walking for a while, you can always put it off for a few months since living with babyproofed doors, drawers, etc. can be a bit annoying.
We waited, but we kind of regret it since we were sooooo tired after the arrival of our daughter. It takes a while to set up all the materials, so if you want to save yourself the time and effort before you have to start constantly caring for the baby then go right ahead!