Is it okay to retract your baby boy's genitalia during cleaning time?

Please don't do that! My pediatrician had asked not to do so! The usual bathing cleans it.