In this game Dexterity is what makes accuracy possible with bows/crossbows.
In my example above, if you only have a 49% chance to hit the target, you can put put 500 points into perception, but guess what, you're still only ever going to have a 49% chance to hit the target because the only way to raise the 49% chance to hit in this case is through dexterity.
So if you do not raise that 49% chance to hit through dexterity then you will just about always miss the target no matter how high your perception is.