The exact formula is as follows:
Maximum AP = 7 + CON
Starting AP = 2 + (PER + SPEED) / 2
Turn AP = 3.5 + SPEED / 2
Or with the Glass Cannon talent:
Maximum AP = 7 + CON
Starting AP = 2 + (PER + SPEED) / 2
Turn AP = 7 + SPEED
If you don't take Glass Cannon your best bet is to do what Stabbey suggested. Put points into speed. With Glass Cannon however (which is one of the strongest talents in the game) you can see from the formulae that putting points into speed without raising constitution will actually LOSE you action points. With Glass Cannon you better make sure CON > SPEED, to be able to save the odd AP.
(Note: with Glass Cannon and Lone Wolf Turn AP are 11 + SPEED (and MAX are 9 + CON), so in that case you simply must raise CON at least by 2 to profit from your turn AP.)