I had swollen and tender armpits during pregnancy too, and it can happen because your body is going through so many changes and your lymph nodes can react to that. That said, it's definitely worth getting your PD or gynae to check it out just to be safe, especially if it's painful or if you notice any other symptoms like fever or redness, since they'll want to rule out anything else.
Jing Yi