This also takes out all the fun from exploring - what's the point in finding a secret passage earlier than expected if the first enemies I encounter are mathematically impossible to beat due to a 2 level difference?
There seems to be a minor problem with the reduced number bloat mod (magic damage gets reduced slightly more than physical damage), but I hope that the issue gets fixed very soon - the mod author seems to know what he does.
Expecting to have a means to go anywhere from the word go in the world, through means of a sword or a key, is very silly if you think about the long reaching consequences of such a thing. Sure you may not be able to go through the secret cave because of tough monsters, but that just gives you something to look forward too. As well as making it all the more sweet when you claim whatever gold and treasures lay beyond.