This is correct, you do not get the bonus to attack on the offhand attack