As soon as you understand the mechanics the current difficulty is pretty easy, in my opinion. Even the difficult fights like Matriarch Spider, 2 Minotaurs 1 Party and the Gith Gang are quite easy as soon as you've identified the solution to them, though of course RNG may require you to reload and try again.
Game is definitely going to need more difficulty levels and/or tweaking before release if combat challenge is going to be enjoyable for the entirety of the game, right now for me (a D&D veteran) the game had a bit of a learning curve in identifying what changes were made to the rules and how that worked it practice and the the challenge very much plateaued at somewhere around "easy" to "very easy" for almost all encounters. And there's not really enough new abilities or spells to change things up so those easy encounters are all handled more or less with the exact same tactics, other than what the location changes up