When the quest marker icon is in the book, it puts an icon on the map/minimap for me. Maybe you aren't zoomed out enough to see it.

It's not just Teleport and Pheonix Dive: You can also use the Warrior's Rush to move through doors and solid walls.