I honestly don't want to add too much difficulty to it, but I don't want it to be as easy as it is right now. IMO the problem with resting right now is the fast travel system. If you had to get to a fast travel point in order to fast travel anywhere, including to get to your camp before you could take a nights rest and if there was a chance your nights rest could be interupted by some kind of random encounter attack on your camp you would have a fine system worthy of the original games.
Needing to walk to a fast travel point would start to feel like pointless busywork unless there was the chance for a random encounter or something. And in a system without a human DM to manage, random encounters have issues.