That's a good point. Perhaps adding some additional bonuses to the existing skills as they are before might alleviate that?

Even if your dagger would scale with both finesse and Intelligence, Finesse and Intelligence both give a different secondary bonus on top of their damage boost. Intelligence increasing range for skills, finesse increasing movement speed, constitution adding to phys+magic armour?

Just spitballing here, but I don't think my idea is merely a bandaid, but just part of a solution. It still increases build diversity even if attributes give additional different bonuses as changing the attributes by adding things does not remove the problems I mentioned in the OP.