Me too find the game a challenging, especially in the beginning of the game, and I play whole game on the lowest difficulty!

So, it's for sure not a shame to play (the first time) on the lowest difficulty. wink
But maybe you play already on that lowest difficulty?
So sorry than for this stupid advice smirk

On 7th of february 2015 : I start a new adventure in the Divinity world of Original Sin,
it's a Fantastic Freaking Fabulous Funny ... it's my All Time Favorite One !