Taking a talent Zen A. you get an advantage. But you do not get same result as regular archer. Got it?
Yes. You've burned / wasted a talent on just... swapping what a set of weapons scale off of. That, by itself, is detrimental enough to make such a talent hardly worth it, let alone bogging it down with things that make it literally useless.
If you spend a talent, it should either be nothing but benefit, or if it has downsides the benefits should be freaking HUGE.
Spending a talent just to change what a few (or even ALL) weapons scaled off of is, itself, not really worth a talent. Then adding downsides onto that talent makes it objectively bad.
Using D&D (Specifically Pathfinder) as a reference ; rogues get the ability to use weapon finesse not only on a specific EXTRA weapon, but also get weapon finesse for free, and add dex to damage and not just to-hit.
What you're suggesting would be, say, making a rogue buy weapon finesse, except on top of it only working for to-hit, it also only gives you one point of to-hit bonus for every other point of dexterity mod you have.
Assuming you don't care about D&D / Pathfinder just take this tl;dr - while making there indeed be talents that make your weapons scale off other attributes itself isn't bad... making those talents objectively worse than just investing a couple of fare more plentiful stat points into the basic stat is BAD.