Thanks for the advices everyone, this place is surprisingly more friendly than the Steam forums, haha.
So I started the game over, again. This time I changed my party a little bit, ending up like this:
Beast: warrior with shield + Geomancer for fortify. I also picked Lucky Charm as my first skill, and it's paying off like crazy. Getting greens out of barrels which helps a lot.
Red Prince: two handed warrior + Pyromancer for haste n stuff.
Lohse: same, water + air with staff, mostly to heal and clean bad stuff from the ground.
Sebille: rogue again, but with Necromancer for lifesteal.
This time I made sure to complete quests that I wasn't even aware they were there and give tons of XP , like the one that requires playing with the kid in the cave (not to mention, a very powerful spear also). I hate kids, I sent him away instantly when he started yelling nonsense - turns out, I
had to play with him if I wanted to progress properly. Kinda lame if you ask me. Not to mention, if you want his reward, you need the Teleportation Gloves which are inside a Crocodile (?).
It's like playing a completely different game. Now that I know the "order" of how the fort must be completed things are much,
much smoother. But that's not the mark of a good game, isn't it? A true RPG shouldn't punish you for following the path you like; in fact, it should reward you more. Not here, sadly.

I can't right click the popup box to send an item to wares or read a book without picking it up
But you *can* do that, though. At least reading something without picking it up.
What I meant is that I can't right click the popup box, the one that appears when I press Left Alt. I have to search for the item lying around, which is usually small and annoying, and right click it. Since the camera appears to be drunk, this task becomes extremely annoying, so I just pick the item and use it, then drop it.
---------------------------------------------------------------------------------------
Well, for now my journey continues with less bumps, but it demanded me many restarts, which is not good. I hope the devs can learn from the experience I had, which seems to be repeated in many other players.
Keep the comments coming tho, I like reading the experiences of the rest.
PS: Sebille uses Flesh Sacrifice - "Glory is mine!". Eerrr... ok? If you say so.