lvl 2 man at arms skill needs 2 ability points
lvl 3 needs 3
lvl 4 needs 4
lvl 5 needs 5

and 5 is the cap, beyond that only with items ;P