If you've consumed peanut before and baby was fine, I guess the allergy isn't so severe or the amount that's transferred to baby is not significant. So don't worry too much about accidentally consuming peanut. Some children can outgrow their allergies, some don't, we can't really judge ourselves so it's better to see a specialist for advice. All the best!