Uv sterilizer can’t be used with latex, rubber or silicone?

Many websites state that uv rays deteriorate latex, rubber and silicone turning them yellow fast -Is this true? Most pump parts and baby bottles and bottle teats are made from these materials... does this mean we have to replace the pump part and bottles very quickly?