I rarely see any "hit chance" greater than 50-60% and I usually miss about 90% of the time even with 50% odds (it's like XCom math for me here).
This is your issue right here. You should be able to get >60% chance to hit on most attacks, so something is up. Your Dex is a bit low if you're level 4, but not low enough to explain <60% hit chances. You're using finesse or ranged weapons, so that's good - you're actually using Dex to attack.
If you could provide us a with a screenshot where you're in a combat and have that <50-60% chance-to-hit, that'd be great. In the same place it tells you your chances to hit, it should also mention any bonuses and penalties to the roll. The combat log specifics of the roll after the attack is made might also be helpful, as it (might) tell you exactly what was added/subtracted from the roll.
