It depends on the weapon you use. Some weapons are purely strength based, some are agility based and some are a combination of the two.
Agility influences your accuracy and evasion, so I would worry about getting those values up enough and meeting any minimum equipment requirements before deciding whether to use agility or strength for the damage bonus.