HELP! Why my baby shun pacifier??

My baby is 3 months old didn't know still to suck pacifier or just reject taking it. Should I be worrying? Is there any concern that is not normal. His older brother doesn't hv this problem during his infancy period.