My son just ate 1/4 of a moldy bun which he took out of his school bag. Should I be concerned and what will happen?

Monitor him carefully. If he show any signs of uncomfortable, vomit or diarrhoea than bring him to a doctor as soon as possible. There would be times that the child is able to expel it normally through the bowel. Just monitor him carefully.