I agree fast travel should only be possible from specific waypoints, its just to easy now, plus is would go a long way with solving spam resting after each fight if you actually had to travel to a waypoint to go back to camp.
I also loved Maximuuus idea from an older thread to use BG map for fast travel rather than portals.