As soon as you pick the orb, the door unlocks.

No need to use it, the ghost is indeed strong, and you should probably wait a few levels.