It would not affect the sense of hearing per se. It might just lead to the baby getting comfortable to noise. However, for you, it might lead to restlessness and increased blood pressure, if the noise is too loud. If you can, try and find a quiter place.