Exclusive pumping mum

I have been EP for a month now, every 3 hourly. But the midnight pumps are really killing me. Im extremely tired as I take care of baby on my own + pumping and cleaning of her stuff. Would my milk supply drop if I stretch or cut down on 1 night pump? Or if I were to stretch my pumps to every 4hourly, will my milk be lesser? Im only a just enough mum pumping arnd 120ml each session.