Oh, if you're doing Lone Wolf, that's completely different. Due to the doubled Attributes and Combat Abilities, it is totally viable to split between two primary attributes. In fact, in the DE, that's actually strongly encouraged.
If you want Physical damage weapons which scale off of INT, the concern with that is that it would make INT a superior attribute, replacing FIN and STR. It would make a new "meta" of "hybrid" builds which pump only INT and can be extremely effective at both physical and magical damage.
The main downside would be that some Warfare, Huntsman, Scoundrel, and Poly skills wouldn't get scaling benefit.
