Baby Underweight

Should I be worry for my 16mo baby not gaining weight (falls below 3 percentile). He has been eating/drinking well and active. Milk intake 500-700ml per day, 1 meal (porridge/rice) and fruits. Polyclinic doctor refer us for specialist, shld we monitor first?