It's perfectly fine. My son does that too when he was a newborn. He slept with me on our bed, so I would move myself either to his left or right depending on where he is facing.
Occasionally I would move his head to face the other way. Older folks say this is to prevent the flat head syndrome.