Martial classes used to in earlier editions. Classes used to get a different Base Attack Bonus progression in a similar fashion to how casters get their Spell Caster Levels differently (I.e. 1/3rd progression for classes like EK and AT, 1/2 progression for Ranger and Paladin, full progression for Bard, Wizard, Sorcerer etc)
This used to be 1 BAB per level for the likes of Fighter, Barbarian, Paladin, Ranger
While only 0.75 BAB per level for the likes of Rogue, Cleric, Bard, Artificer etc.
With Wizard and Sorcerer having the puny 0.5 BAB per level scaling.
BAB would not only be a modifier to attack rolls, but would also determine attack speed (How many attacks per action you take)
However, this is no longer the case in recent editions.
Now the only difference between a Martial and a Caster is getting extra attacks per standard action (Level 5 for most classes. Level 6 for martial Bards. Druids (Wildshape only) and Fighters get a second extra attack on levels 10 and 11 respectively)
As such, there should not be any difference between a Fighter and Sorcerer in terms of accuracy when using the same weapon (With the same proficiency) and the same stats (And other modifying effects)
In regards to missing a lot... Make sure the weapon you're using utilizes the stat you've got. All ranged weapons use Dex. Some special weapons will use your character's spellcasting stat.
