I believe this is a normal behaviour as it happens to all my 4 babies.
Babies are just curious about themselves and wanna explore more.
Actually suckling is a form of comfort for them too.
You don't have to worry at all.
Do take note and make sure that the don't put their fist inside their mouth.
Read more