The phase spider didn't hit too often after its first sneak attack. While it does have a lot of hit points, you can burn the webs underneath it or push it off the edge to do pretty large damage. I beat it with a level 3 party that was mostly running on fumes for abilities. (No spells at all for Shadowheart)