Ah the weapon AP usage does make sense. Perhaps a simple pop up the first time you open your inventory would be enough to clear it out. Seeing as there's no axe/sword/etc. mastery, only two-hand/one-hand/dagger, I can see it working.

As for the orange hand, now that you point it out, yes I can see it. (I also noticed that chest/etc. you've opened give a grey hand, instead of the normal light orange). I would definitely say there needs to be more difference between the colours for "You've not opened this" and "You've not opened this, it's also locked".