The Rift Travel button should flash (and keep flashing until pressed) when it first appears after your conversation with Zix-Zax.

Many people don't even notice the button show up for the first time, myself included.