That is odd, try to set it as a hot key item (click and drag it) and see if you can use it that way.
why not just press U and teleport? =)
i always used it this way, never even clicken it
when doing that quest with chicken rune (peaceful solution), reward is Much Better!
