The passage is actually IN the Pirate Office. But you need to examine the room carefully before you find out how to reveal it.

The spoiler:
The painting behind the desk.

Unless otherwise specified, just an opinion or simple curiosity.