Actually, it is very well possible to leave the town without exploring at all right after you enter it (with or without picking up the companions). So far, I have almost 50 hours on Steam and have not done a single quest yet. The fights might be a little bit on a hard side, but if anything else fails the guards at the town gates are usually pretty helpful if you lure the foes to them.
