Right now (with the latest update) the skill system really favors the hybrids much more than specialists. However, it was just a test implementation and Larian already said that they will change the system with the next update so that specializing will be much more rewarding.