You can avoid that area if you wish, but you will miss out on a stat point (from mind reading the ghost) and something else of value. Think of it as finally allowing him to rest in peace.
evil

if you activate a couple statues, or something, you get a couple platforms to be able to jump up and pull a lever to lower four pieces of equipment from the ceiling. A skill book near where you first show up will also be lowered. Taking any of these items raises the rest out of reach.