Pro tip: In the gazillion difficulty options there is one to modify the number of enemies, which includes enemies per encounter and also the number of encounters. That applies to the first dungeon too.
If you find there are too many encounters for your taste, check the option because if you are playing hard mode you may have it to the maximum.