I totally agree. It's actually very immersion breaking and it works like an exploit bug. Resting feel totally disconnected to the story you're writing and it's absolutely not an interresting part of the gameplay...
We definitely shouldn't be able to click that button everywhere without any consequences and it shouldn't work as a fast travel. Resting has to be part of the things players have to manage and think about. Not the cheesy way to heal/restore spell slots/skills...
Localized rest won't solve anything about that mecanic, but it will are least solve everything about immersion.
