You can complete all of the EA area with a non-optimised build, and we currently have no reason to believe that this will be different for the rest of the game. You can't get all your stats above 15 anyway (at least right now), so some part of your character is always going to be "weak".