That's not bad. Only let the player upgrade a charm with one the provides the same type of bonus (eg. Constitution, etc.). It makes a bit of a compromise with the rigid charm system.