This is why I think all weapons and abilities should scale with either multiple attributes, or not tie them to any. That way you'd have more build diversity.
(and yes, it'd be fun playing a dirty-fighting scoundrel who throws dust and uses choloroform + some other magic damage stuff while still being a finesse character)