Those few stats points doesnt actually help much, even in the beginning from my view. Anyway its all down to personal preference. And its undeniable that there a lot area in game are packed with boxes and barrels. Definitely you can break them 1 by 1 if prefer, but I choose to break all once using whirlwind, which seems more convenient to me.
