I believe this is a normal behaviour as it happens to all my 4 babies. Babies are just curious about themselves and wanna explore more. Actually suckling is a form of comfort for them too. You don't have to worry at all. Do take note and make sure that the don't put their fist inside their mouth.
Read more