Baby's size

Some people told me that my tummy is smaller for a 20-week. It's my first pregnancy. Should I be worried?