I'm not sure what Larian's intent with this room was, since we can blast down so many tough objects (like reinforced wizard tower doors :V) yet a fallen, decrepit bookshelf is an insurmountable obstacle.
If you're already inside the room, there is just barely enough room to make a jump out near the bookshelf's bottom half. AI should follow in turn, but yeah, teleporting to the nearest waypoint it much less frustrating.
