Movements hurting baby?

I'm at 31 weeks and so paranoid that any of my movements will affect baby. Like when I toss and turn in my sleep. And when I'm putting on pants or bottoms, my stomach will fold on itself and I'm scared this will hurt him.