You could get them confused very easily.
As it stands now, there are a variety of different weights in the higher registers, and nobody is really complaining. I think it would really depend on the person who is using them.
I keep different types of pellets in separate containers that are marked clearly.
The manufacturers could add a shot of dye to the plastic, giving the pellet a little bit of tint to help distingush the different weights.
As it stands now, My .12g are all yellow or translucent white,
my standard grade .20s are flat white,
my high grade 20s are bright white,
and my .23s have a light blue tint.
So far I don't really have a problem with mix ups.