Yes why not? esp in western cooking, herbs are added to pasta sauce, stews etc. You can also consider buying fresh herbs to use first to ensure you baby doesn't have any allergic reaction.
Btw I notice the last ingredient is organic lemon "essential oil". Personally I won't let my baby ingest essential oil. If you want to use lemon, you can squeeze some fresh lemon juice (great for fish!)
Read more